00000001:02000400:3.0F:1784404471.561164:0:3302:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1784404491.595262:0:3523:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1784404493.382292:0:3586:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 727 MB/s 00000001:01000000:2.0:1784404493.634543:0:3586:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 948 MB/s 00000001:01000000:3.0:1784404493.884195:0:3586:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4143 MB/s 00000020:02000000:1.0F:1784404494.822605:0:3615:0:(class_obd.c:729:obdclass_init()) Lustre: Build Version: 2.17.54_174_g53e1600 00000400:02000000:1.0:1784404496.154681:0:3630:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.202.142@tcp [8/256/0/180] 00008000:02000000:2.0:1784404499.988360:0:3780:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1784404558.527193:0:5746:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784404571.264654:0:6496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784404571.264661:0:6496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784404571.264663:0:6496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784404571.264816:0:6496:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000217b6b9b 00000080:02000400:2.0:1784404571.264838:0:6496:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1784404571.273954:0:6496:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1784404571.273971:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784404571.274005:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000638a0c71) 00000020:00000080:2.0:1784404571.274029:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784404571.353717:0:6496:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784404571.354036:0:6496:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1784404571.384685:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784404571.385136:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784404571.385146:0:6496:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784404571.385160:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7885d 00000020:01000004:3.0:1784404571.385167:0:6496:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784404571.385172:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784404571.385176:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000217b6b9b from MGS 00000020:01000004:3.0:1784404571.385180:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784404571.385202:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a3a0aacf) 00000020:00000080:3.0:1784404571.385212:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784404571.393647:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000217b6b9b from MGS, refs=2 00080000:01000000:0.0:1784404571.393664:0:6496:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784404571.393676:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7886b 00000100:00100000:0.0:1784404571.393934:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1784404571.394067:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1784404571.394074:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784404571.395001:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784404571.395010:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784404571.397899:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784404571.398115:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784404571.398121:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1784404571.403050:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1784404571.403065:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784404571.403816:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784404571.403834:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784404571.405806:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404571.405811:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404571.405812:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404571.406173:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404571.406176:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404571.406177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404571.407141:0:6496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1784404571.412433:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1784404571.659243:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2916 MB/s 00000001:01000000:0.0:1784404571.909047:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2967 MB/s 00000001:01000000:0.0:1784404572.159548:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 503 MB/s 00000001:01000000:0.0:1784404572.409151:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 735 MB/s 00080000:10000000:0.0:1784404572.413838:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1784404572.422423:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1784404572.426031:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784404572.427643:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784404572.427702:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784404572.427745:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1784404572.428058:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784404572.428082:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784404572.428408:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784404572.428560:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784404572.428567:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784404572.433353:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784404572.433369:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784404572.433739:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784404572.433746:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784404572.434941:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784404572.434964:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.142@tcp' 00000020:01000004:1.0:1784404572.434966:0:6496:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784404572.435107:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.142@tcp (typ=mgc) 00000020:00000080:1.0:1784404572.435126:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.142@tcp (00000000c4ab1c67) 00000020:00000080:1.0:1784404572.435143:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784404572.435224:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008714ddb2@MGC192.168.202.142@tcp: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784404572.435369:0:6496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.142@tcp-0 is initialized 00000040:01000000:1.0:1784404572.435376:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 1 is initialized 10000000:01000000:2.0:1784404572.439023:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784404572.439077:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.142@tcp (uuid 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3) 00000020:00000080:2.0:1784404572.439100:0:6496:0:(genops.c:1385:class_connect()) connect: client 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3, cookie 0x24b3e2e6dcd78879 00000100:00080000:2.0:1784404572.439113:0:6496:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404572.439118:0:6496:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import 000000008714ddb2 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404572.439163:0:6496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ec78cb6e x1871083728797824/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404572.439185:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS 00000020:01000004:2.0:1784404572.439202:0:6496:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784404572.439208:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784404572.439220:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002aaaebef) 00000020:00000080:2.0:1784404572.439232:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1784404572.441367:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ec78cb6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3645:1871083728797824:0@lo:250: 00000100:00100000:3.0:1784404572.441455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404572.441532:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728797824 00000100:00100000:3.0:1784404572.441541:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728797824 00000100:00100000:3.0:1784404572.441575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404572.441582:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000142edeb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1871083728797824:12345-0@lo:250: 00010000:00080000:3.0:1784404572.441607:0:6511:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1784404572.441633:0:6511:0:(genops.c:1385:class_connect()) connect: client 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3, cookie 0x24b3e2e6dcd78887 00000100:00080000:3.0:1784404572.441765:0:6511:0:(import.c:65:import_set_state_nolock()) 000000005a141a62 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784404572.441829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000142edeb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:3645:x1871083728797824:12345-0@lo:250: Request processed in 246us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404572.441837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404572.443200:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784404572.443209:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.142@tcp: connect to target with instance 0 00000100:00080000:3.0:1784404572.443214:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784404572.443218:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784404572.443221:0:3645:0:(import.c:65:import_set_state_nolock()) 000000008714ddb2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784404572.443223:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784404572.443230:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784404572.443234:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ec78cb6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3645:1871083728797824:0@lo:250: 00000100:00080000:0.0:1784404572.444186:0:6515:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1784404572.451229:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404572.451459:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1784404572.451463:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784404572.455200:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784404572.455211:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784404572.456328:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784404572.456336:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784404572.456922:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404572.457060:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784404572.457063:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784404572.457466:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784404572.457477:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784404572.481712:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404572.482004:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784404572.482009:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784404572.482922:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784404572.482929:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784404572.483377:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784404572.483498:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784404572.483502:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784404572.484134:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784404572.484139:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784404572.485176:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404572.486034:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784404572.486039:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784404572.488684:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784404572.488695:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784404572.489603:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404572.489734:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784404572.489744:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784404572.490327:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784404572.490333:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784404572.515131:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784404572.515313:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784404572.515320:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784404572.516481:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784404572.516490:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784404572.517453:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784404572.517461:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784404572.518230:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784404572.518259:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784404572.518265:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784404572.518361:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784404572.518393:0:6496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784404572.518402:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784404572.518403:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784404572.518405:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404572.518405:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404572.518406:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404572.518408:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404572.518409:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784404572.518410:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784404572.518411:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784404572.518412:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784404572.518413:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404572.518415:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784404572.518418:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784404572.518420:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784404572.518433:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784404572.518434:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404572.518435:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404572.518436:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404572.518437:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404572.518438:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784404572.518439:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784404572.518440:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784404572.518441:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784404572.518441:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404572.518442:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784404572.518482:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784404572.518498:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b0840d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728797952:0@lo:253: 00000100:00100000:3.0:1784404572.518580:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404572.518692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728797952 00000100:00100000:1.0:1784404572.518700:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728797952 00000100:00100000:3.0:1784404572.518764:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b5e3793 going to sleep for 11 seconds 00000100:00100000:1.0:1784404572.521747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404572.521768:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d263ec9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:6496:x1871083728797952:12345-0@lo:253: 20000000:01000000:1.0:1784404572.521844:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784404572.521847:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1784404572.522311:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784404572.522367:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1784404572.522666:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404572.523671:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1784404572.524125:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784404572.524130:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1784404572.524135:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1784404572.524138:0:6514:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1784404572.524152:0:6514:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1784404572.528912:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404572.529140:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1784404572.529163:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404572.529182:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1784404572.529200:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1784404572.529215:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1784404572.529285:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1784404572.529294:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1784404572.529308:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1784404572.529314:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1784404572.529327:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1784404572.529332:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1784404572.529345:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1784404572.529359:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1784404572.529387:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1784404572.529392:0:6514:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1784404572.529400:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404572.529882:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1784404572.529894:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784404572.529913:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1784404572.529940:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1784404572.529953:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1784404572.529974:0:6514:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1784404572.530004:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1784404572.530011:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784404572.530021:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1784404572.530032:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1784404572.530044:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1784404572.530050:0:6514:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1784404572.530067:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1784404572.530073:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1784404572.530083:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1784404572.530094:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1784404572.530135:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1784404572.530158:0:6514:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1784404572.530164:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1784404572.530585:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1784404572.530750:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1784404572.530767:0:6514:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.142@tcp for mdt 20000000:01000000:1.0:1784404572.530769:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404572.530779:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1784404572.530784:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784404572.530794:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1784404572.530799:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404572.530810:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1784404572.530828:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784404572.530843:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1784404572.530923:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1784404572.530947:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784404572.530950:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784404572.530953:0:6514:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784404572.531000:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784404572.531002:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784404572.531371:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1784404572.531654:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1784404572.531689:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1784404572.531704:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1784404572.531712:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784404572.531714:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784404572.532100:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1784404572.532243:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1784404572.532260:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1784404572.532276:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1784404572.532287:0:6514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784404572.532290:0:6514:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1784404572.532293:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784404572.532296:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784404572.532301:0:6514:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784404572.532314:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784404572.532693:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1784404572.532797:0:6514:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1784404572.539360:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1784404572.539402:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1784404572.539479:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1784404572.539618:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784404572.539642:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539660:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539671:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539677:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539683:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539689:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539695:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a0a75a1 already unused, calling callback (000000000d2bce25) 00010000:00010000:1.0:1784404572.539698:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539704:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539731:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539737:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.539742:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a0a75a1/0x24b3e2e6dcd7888e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784404572.539761:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784404572.548219:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d263ec9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:6496:x1871083728797952:12345-0@lo:253: Request processed in 26453us (29631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404572.548240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404572.548314:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b0840d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728797952:0@lo:253: 10000000:01000000:3.0:1784404572.548329:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784404572.548332:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784404572.548341:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784404572.548343:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404572.548344:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1784404572.548345:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404572.548346:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404572.548348:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784404572.548349:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784404572.548351:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784404572.548352:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404572.548354:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784404572.548372:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000217b6b9b from lustre-MDT0000 10000000:01000000:3.0:1784404572.548405:0:6496:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784404572.548407:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784404572.548412:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dd545b94d40 10000000:01000000:3.0:1784404572.548417:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784404572.548424:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd545b94d40 from 1 10000000:01000000:3.0:1784404572.548427:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784404572.548460:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404572.548471:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404572.548480:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404572.548498:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b0840d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798080:0@lo:101: 00000100:00100000:3.0:1784404572.548606:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404572.548736:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eeb6074a going to sleep for 11 seconds 00000100:00100000:0.0:1784404572.548778:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798080 00000100:00100000:0.0:1784404572.548786:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798080 00000100:00100000:0.0:1784404572.548884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784404572.548892:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002433fc81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:6496:x1871083728798080:12345-0@lo:101: 00010000:00010000:0.0:1784404572.548907:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404572.548921:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78895 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.548946:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.548956:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.548964:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e986e92, rc 0) 00000100:00100000:0.0:1784404572.549006:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002433fc81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:6496:x1871083728798080:12345-0@lo:101: Request processed in 115us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404572.549012:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404572.549096:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b0840d0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798080:0@lo:101: 00010000:00010000:1.0:1784404572.549109:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.549117:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404572.549175:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798208:0@lo:501: 00000100:00100000:1.0:1784404572.549200:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404572.549261:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798208 00000100:00100000:3.0:1784404572.549265:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798208 00000100:00100000:3.0:1784404572.549289:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784404572.549294:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5529d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:6496:x1871083728798208:12345-0@lo:501: 00000100:00100000:3.0:1784404572.549377:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5529d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:6496:x1871083728798208:12345-0@lo:501: Request processed in 83us (177us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784404572.549383:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404572.549485:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097bda03b going to sleep for 11 seconds 00000100:00100000:1.0:1784404572.549498:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798208:0@lo:501: 10000000:01000000:1.0:1784404572.549592:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784404572.549637:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.549645:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404572.549662:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd544dfc000 10000000:01000000:1.0:1784404572.549666:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784404572.549670:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd544dfc000 10000000:01000000:1.0:1784404572.549672:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784404572.549674:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dd544dfc000 from 1 10000000:01000000:1.0:1784404572.549676:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784404572.549692:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000023cf689/0x24b3e2e6dcd788a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.549699:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000023cf689/0x24b3e2e6dcd788a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.549706:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000023cf689/0x24b3e2e6dcd788a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404572.549717:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798336:0@lo:101: 00000100:00100000:1.0:1784404572.549741:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404572.549791:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097bda03b going to sleep for 11 seconds 00000100:00100000:0.0:1784404572.549975:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798336 00000100:00100000:0.0:1784404572.549979:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798336 00000100:00100000:0.0:1784404572.550034:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784404572.550040:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0fbfd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:6496:x1871083728798336:12345-0@lo:101: 00010000:00010000:0.0:1784404572.550048:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404572.550057:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089aaf8d6/0x24b3e2e6dcd788aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd788a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.550071:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089aaf8d6/0x24b3e2e6dcd788aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd788a3 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.550079:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089aaf8d6/0x24b3e2e6dcd788aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd788a3 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.550099:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089aaf8d6, rc 0) 00000100:00100000:0.0:1784404572.550137:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0fbfd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+7:6496:x1871083728798336:12345-0@lo:101: Request processed in 98us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404572.550143:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404572.550197:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798336:0@lo:101: 00010000:00010000:1.0:1784404572.550206:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000023cf689/0x24b3e2e6dcd788a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.550214:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000023cf689/0x24b3e2e6dcd788a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404572.550223:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784404572.550238:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000023cf689/0x24b3e2e6dcd788a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.550255:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000023cf689/0x24b3e2e6dcd788a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404572.550260:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784404572.550263:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784404572.550267:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd544dfc000 10000000:01000000:1.0:1784404572.550269:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784404572.550272:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784404572.550273:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784404572.550286:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.550293:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.550298:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404572.550308:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798464:0@lo:101: 00000100:00100000:1.0:1784404572.550334:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404572.550446:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097bda03b going to sleep for 11 seconds 00000100:00100000:3.0:1784404572.550509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798464 00000100:00100000:3.0:1784404572.550513:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798464 00000100:00100000:3.0:1784404572.550532:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404572.550537:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082358303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+7:6496:x1871083728798464:12345-0@lo:101: 00010000:00010000:3.0:1784404572.550544:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404572.550552:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd788b1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404572.550564:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404572.550570:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404572.550575:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f18930a4, rc 0) 00000100:00100000:3.0:1784404572.550610:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082358303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+8:6496:x1871083728798464:12345-0@lo:101: Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404572.550616:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404572.550672:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798464:0@lo:101: 00010000:00010000:1.0:1784404572.550681:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.550687:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404572.550736:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798592:0@lo:501: 00000100:00100000:1.0:1784404572.550759:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404572.550781:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097bda03b going to sleep for 11 seconds 00000100:00100000:3.0:1784404572.550828:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798592 00000100:00100000:3.0:1784404572.550832:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798592 00000100:00100000:3.0:1784404572.550848:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784404572.550881:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058510223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+8:6496:x1871083728798592:12345-0@lo:501: 00000100:00100000:3.0:1784404572.550992:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058510223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6496:x1871083728798592:12345-0@lo:501: Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404572.550999:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404572.551091:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798592:0@lo:501: 00000100:00100000:1.0:1784404572.551115:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798720:0@lo:503: 00000100:00100000:1.0:1784404572.551152:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404572.551169:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097bda03b going to sleep for 11 seconds 00000100:00100000:3.0:1784404572.551208:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798720 00000100:00100000:3.0:1784404572.551212:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798720 00000100:00100000:3.0:1784404572.551229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404572.551233:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b02576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6496:x1871083728798720:12345-0@lo:503: 00000100:00100000:3.0:1784404572.551342:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b02576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6496:x1871083728798720:12345-0@lo:503: Request processed in 109us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404572.551350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784404572.552062:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728798720:0@lo:503: 00000100:00100000:0.0:1784404572.552445:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001861de16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6541:1871083728798848:0@lo:502: 00000100:00100000:0.0:1784404572.552494:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404572.552533:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea543eb9 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.552579:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798848 00000100:00100000:2.0:1784404572.552584:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798848 00000100:00100000:2.0:1784404572.552620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784404572.552626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8eab3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6541:x1871083728798848:12345-0@lo:502: 00000100:00100000:2.0:1784404572.552726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8eab3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6541:x1871083728798848:12345-0@lo:502: Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.552733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784404572.552804:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001861de16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6541:1871083728798848:0@lo:502: 00000020:01000000:1.0:1784404572.552837:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404572.552848:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404572.552883:0:6541:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784404572.552888:0:6541:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784404572.552891:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784404572.552904:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001acddd28) 00000020:00000080:1.0:1784404572.552920:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784404572.552924:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784404572.553002:0:6541:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784404572.553009:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd788c6 00000020:00000080:1.0:1784404572.553240:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784404572.553245:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404572.553249:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404572.553250:0:6541:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784404572.553252:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404572.553256:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404572.553257:0:6541:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784404572.553259:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784404572.553274:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b036eb1b) 00000020:00000080:1.0:1784404572.553283:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784404572.553287:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784404572.553288:0:6541:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784404572.553291:0:6541:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784404572.553296:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784404572.553336:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000217b6b9b from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784404572.553347:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000540135c4) 00000020:00000080:1.0:1784404572.553364:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784404572.553421:0:6541:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784404572.553427:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd788db 00000020:00000080:1.0:1784404572.553513:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784404572.553519:0:6541:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784404572.553524:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x24b3e2e6dcd788e2 00080000:01000000:1.0:1784404572.553529:0:6541:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784404572.553532:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd788e9 00080000:10000000:1.0:1784404572.553969:0:6541:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1784404572.554096:0:6541:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1784404572.560727:0:6541:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1784404572.635089:0:6541:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784404572.635723:0:6541:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784404572.639169:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784404572.639782:0:6541:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784404572.642483:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004a3afc6d) 00000020:00000080:3.0:1784404572.643458:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784404572.643675:0:6541:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784404572.643683:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd788f7 00000020:00000080:3.0:1784404572.643960:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1784404572.647127:0:6541:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.650938:0:6541:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.655536:0:6541:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.663441:0:6541:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.665778:0:6541:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.667724:0:6541:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1784404572.669559:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x24b3e2e6dcd788fe 00000020:00000080:3.0:1784404572.670009:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784404572.670020:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404572.670026:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404572.670028:0:6541:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784404572.670031:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404572.670035:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404572.670042:0:6541:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784404572.670045:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784404572.670047:0:6541:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784404572.670049:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404572.670051:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404572.670052:0:6541:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784404572.670054:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404572.670058:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404572.670059:0:6541:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784404572.670062:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784404572.670097:0:6541:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1784404572.670152:0:6541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000afee26e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6541:1871083728798976:0@lo:502: 00000100:00100000:3.0:1784404572.670222:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404572.670262:0:6541:0:(client.c:2702:ptlrpc_set_wait()) set 0000000053bb5fb2 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.670316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728798976 00000100:00100000:2.0:1784404572.670322:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728798976 00000100:00100000:2.0:1784404572.670362:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404572.670369:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a72458cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6541:x1871083728798976:12345-0@lo:502: 00000100:00100000:2.0:1784404572.670480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a72458cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6541:x1871083728798976:12345-0@lo:502: Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.670495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404572.670593:0:6541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000afee26e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6541:1871083728798976:0@lo:502: 00000020:01000000:3.0:1784404572.670614:0:6541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404572.670618:0:6541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404572.670619:0:6541:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1784404572.670622:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1784404572.671319:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1784404572.671395:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784404572.671445:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.671456:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404572.671463:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd544dfc000 from 1 10000000:01000000:2.0:1784404572.671466:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784404572.671508:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.671516:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.671524:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404572.671539:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f45eb684 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799104:0@lo:101: 00000100:00100000:2.0:1784404572.671671:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.671705:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000be3afdea going to sleep for 11 seconds 00000100:00100000:0.0:1784404572.671762:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728799104 00000100:00100000:0.0:1784404572.671768:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728799104 00000100:00100000:0.0:1784404572.671805:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404572.671822:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ab65b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:6496:x1871083728799104:12345-0@lo:101: 00010000:00010000:0.0:1784404572.671833:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404572.671846:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78905 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.672056:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.672066:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.672074:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078195ff2, rc 0) 00000100:00100000:0.0:1784404572.672117:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ab65b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:6496:x1871083728799104:12345-0@lo:101: Request processed in 306us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404572.672123:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784404572.672235:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f45eb684 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799104:0@lo:101: 00010000:00010000:1.0:1784404572.672248:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.672255:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404572.673012:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799232:0@lo:256: 00000100:00100000:1.0:1784404572.673057:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404572.673086:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c6d90d3d going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.673157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728799232 00000100:00100000:2.0:1784404572.673163:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728799232 00000100:00100000:2.0:1784404572.673203:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784404572.673211:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e162a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:6496:x1871083728799232:12345-0@lo:256: 20000000:01000000:2.0:1784404572.673227:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784404572.673233:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784404572.673303:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e162a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:6496:x1871083728799232:12345-0@lo:256: Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.673310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404572.673447:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799232:0@lo:256: 10000000:01000000:1.0:1784404572.674394:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784404572.674420:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.674430:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404572.674438:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd544dfc000 from 1 10000000:01000000:1.0:1784404572.674440:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404572.674468:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.674474:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404572.674482:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404572.674498:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799360:0@lo:101: 00000100:00100000:1.0:1784404572.674706:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404572.674785:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c6d90d3d going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.674829:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728799360 00000100:00100000:2.0:1784404572.674836:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728799360 00000100:00100000:2.0:1784404572.675113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784404572.675121:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4d4813d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:6496:x1871083728799360:12345-0@lo:101: 00010000:00010000:2.0:1784404572.675135:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404572.675149:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78913 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.675171:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.675180:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.675189:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d81133dc, rc 0) 00000100:00100000:2.0:1784404572.675240:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4d4813d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6496:x1871083728799360:12345-0@lo:101: Request processed in 120us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.675246:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404572.675363:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5c54271 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799360:0@lo:101: 00010000:00010000:3.0:1784404572.675378:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404572.675386:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404572.675445:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000afee26e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799488:0@lo:501: 00000100:00100000:3.0:1784404572.675472:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404572.675540:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000053bb5fb2 going to sleep for 11 seconds 00000100:00100000:1.0:1784404572.675775:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728799488 00000100:00100000:1.0:1784404572.675780:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728799488 00000100:00100000:1.0:1784404572.675939:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404572.675946:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009172b61e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6496:x1871083728799488:12345-0@lo:501: 00000100:00100000:1.0:1784404572.676107:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009172b61e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6496:x1871083728799488:12345-0@lo:501: Request processed in 162us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404572.676114:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404572.676240:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000afee26e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799488:0@lo:501: 00000100:00100000:3.0:1784404572.676272:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000afee26e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799616:0@lo:503: 00000100:00100000:3.0:1784404572.676313:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404572.676512:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000053bb5fb2 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.676688:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728799616 00000100:00100000:2.0:1784404572.676694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728799616 00000100:00100000:2.0:1784404572.676718:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784404572.676724:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b012b792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6496:x1871083728799616:12345-0@lo:503: 00000040:00080000:2.0:1784404572.676758:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784404572.676803:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b012b792 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6496:x1871083728799616:12345-0@lo:503: Request processed in 79us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.676810:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404572.676926:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000afee26e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799616:0@lo:503: 00000040:00080000:3.0:1784404572.677971:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784404572.678128:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784404572.678148:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404572.678167:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.678179:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404572.678244:0:6496:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784404572.678247:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd544dfc000 10000000:01000000:2.0:1784404572.678250:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd544dfc000 10000000:01000000:2.0:1784404572.678253:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784404572.678258:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd544dfc000 from 1 10000000:01000000:2.0:1784404572.678261:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784404572.678291:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.678299:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.678308:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404572.678337:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799744:0@lo:101: 00000100:00100000:2.0:1784404572.678387:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.678424:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dceeb240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.678442:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728799744 00000100:00100000:2.0:1784404572.678448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728799744 00000100:00100000:2.0:1784404572.678475:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404572.678482:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b9578bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6496:x1871083728799744:12345-0@lo:101: 00010000:00010000:2.0:1784404572.678520:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404572.678532:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78921 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.678552:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.678560:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.678568:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6f58c6f, rc 0) 00000100:00100000:2.0:1784404572.678776:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b9578bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6496:x1871083728799744:12345-0@lo:101: Request processed in 294us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.678783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404572.678839:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799744:0@lo:101: 00010000:00010000:2.0:1784404572.678880:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.678889:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404572.678941:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799872:0@lo:501: 00000100:00100000:2.0:1784404572.678965:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.678978:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dceeb240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.678991:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728799872 00000100:00100000:2.0:1784404572.678994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728799872 00000100:00100000:2.0:1784404572.679031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404572.679036:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a41b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6496:x1871083728799872:12345-0@lo:501: 00000100:00100000:2.0:1784404572.679151:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a41b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6496:x1871083728799872:12345-0@lo:501: Request processed in 115us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.679158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404572.679188:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728799872:0@lo:501: 00000100:00100000:2.0:1784404572.679211:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728800000:0@lo:503: 00000100:00100000:2.0:1784404572.679245:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.679256:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dceeb240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.679267:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800000 00000100:00100000:2.0:1784404572.679271:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800000 00000100:00100000:2.0:1784404572.679286:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404572.679291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fa359d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6496:x1871083728800000:12345-0@lo:503: 00000100:00100000:2.0:1784404572.679373:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fa359d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6496:x1871083728800000:12345-0@lo:503: Request processed in 82us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.679379:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404572.679416:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728800000:0@lo:503: 00000100:00100000:2.0:1784404572.679797:0:6546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6546:1871083728800128:0@lo:502: 00000100:00100000:2.0:1784404572.679841:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.679882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800128 00000100:00100000:2.0:1784404572.679887:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800128 00000100:00100000:2.0:1784404572.679909:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784404572.679914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000beba9a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6546:x1871083728800128:12345-0@lo:502: 00000100:00100000:2.0:1784404572.680004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000beba9a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6546:x1871083728800128:12345-0@lo:502: Request processed in 90us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404572.680010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784404572.680037:0:6546:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea887ae7 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.680055:0:6546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6546:1871083728800128:0@lo:502: 00000020:01000004:2.0:1784404572.680107:0:6546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784404572.680125:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000068bfbd61) 00000020:00000080:2.0:1784404572.680153:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1784404572.680312:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000217b6b9b from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784404572.680316:0:6546:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000217b6b9b from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784404572.680319:0:6546:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000217b6b9b 4 00010000:00080000:2.0:1784404572.680536:0:6546:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000077afc9b8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404572.687184:0:6546:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1784404572.687304:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784404572.688703:0:6546:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784404572.688720:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x24b3e2e6dcd78936 00000100:00080000:2.0:1784404572.688731:0:6546:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404572.688736:0:6546:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000077afc9b8 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404572.688772:0:6546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f5bd8f06 x1871083728800256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404572.688804:0:6546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784404572.690019:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728800256:0@lo:38: 00000100:00100000:3.0:1784404572.690091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.692682:0:6546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e35cf32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6546:1871083728800384:0@lo:502: 00000100:00100000:2.0:1784404572.692766:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.692806:0:6546:0:(client.c:2702:ptlrpc_set_wait()) set 00000000307af027 going to sleep for 11 seconds 00000100:00100000:2.0:1784404572.693003:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800256 00000100:00100000:2.0:1784404572.693011:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800256 00000100:00100000:2.0:1784404572.693043:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784404572.693049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afee26e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728800256:12345-0@lo:38: 00000100:00100000:2.0:1784404572.693114:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afee26e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728800256:12345-0@lo:38: Request processed in 63us (3023us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784404572.693120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404572.693195:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784404572.693204:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000077afc9b8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784404572.693215:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784404572.693218:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5bd8f06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728800256:0@lo:38: 00000100:00100000:3.0:1784404572.693322:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800384 00000100:00100000:3.0:1784404572.693397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800384 00000100:00100000:3.0:1784404572.693465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784404572.693473:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001fffa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6546:x1871083728800384:12345-0@lo:502: 00000100:00100000:3.0:1784404572.693610:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001fffa8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6546:x1871083728800384:12345-0@lo:502: Request processed in 138us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404572.693617:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784404572.693689:0:6546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e35cf32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6546:1871083728800384:0@lo:502: 00000040:00080000:2.0:1784404572.693718:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784404572.693777:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784404572.693795:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784404572.693809:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.693829:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784404572.693893:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784404572.693896:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784404572.693897:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404572.693899:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404572.693900:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404572.693901:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404572.693903:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404572.693905:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784404572.693907:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784404572.693908:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784404572.693909:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404572.693911:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404572.693915:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784404572.693918:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784404572.693919:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784404572.693920:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404572.693921:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404572.693922:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404572.693923:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404572.693924:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404572.693925:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784404572.693926:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784404572.693927:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784404572.693928:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404572.693929:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404572.693944:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784404572.693953:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e35cf32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728800512:0@lo:253: 00000100:00100000:2.0:1784404572.693995:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.694292:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000090974723 going to sleep for 11 seconds 00000100:00100000:1.0:1784404572.694444:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800512 00000100:00100000:1.0:1784404572.694450:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800512 00000100:00100000:1.0:1784404572.694474:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404572.694479:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e20c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6496:x1871083728800512:12345-0@lo:253: 20000000:01000000:1.0:1784404572.694509:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784404572.694523:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784404572.699822:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784404572.699972:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784404572.700255:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e20c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6496:x1871083728800512:12345-0@lo:253: Request processed in 5772us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404572.700268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:2.0:1784404572.700332:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784404572.700336:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784404572.700354:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.700369:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.700376:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.700414:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404572.700428:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 11 pid: 6511 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404572.700441:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008cda7fed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728800640:0@lo:104: 00000100:00100000:2.0:1784404572.700475:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404572.700566:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dceeb240 going to sleep for 11 seconds 00000100:00100000:3.0:1784404572.700782:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e35cf32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6496:1871083728800512:0@lo:253: 10000000:01000000:3.0:1784404572.700795:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784404572.700799:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784404572.700801:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784404572.700802:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404572.700803:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404572.700804:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404572.700805:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404572.700806:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784404572.700808:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784404572.700809:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784404572.700819:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784404572.700820:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404572.700822:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784404572.700839:0:6496:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784404572.701963:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800640 00000100:00100000:0.0:1784404572.701974:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800640 00000100:00100000:0.0:1784404572.703444:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404572.703464:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ceb9325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728800640:12345-0@lo:104: 00010000:00010000:0.0:1784404572.703482:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.703599:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784404572.703604:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ceb9325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728800640:12345-0@lo:104: Request processed in 151us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404572.703611:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784404572.703702:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008cda7fed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728800640:0@lo:104: 00010000:00010000:2.0:1784404572.703735:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1784404572.706174:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.706311:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:0.0:1784404572.706675:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404572.706683:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.706694:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007418515e already unused, calling callback (00000000930d9091) 10000000:00010000:0.0:1784404572.706697:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.706707:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404572.706713:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404572.706718:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404572.706803:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.706809:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404572.706847:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.706890:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000007418515e/0x24b3e2e6dcd78905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7890c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.706908:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404572.706910:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404572.706911:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1784404572.707240:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.707409:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1784404572.707737:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1784404572.707946:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1784404572.708334:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005ebabb54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728800768:0@lo:103: 00000100:00100000:1.0:1784404572.708400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404572.708612:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800768 00000100:00100000:0.0:1784404572.708620:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800768 00010000:00010000:0.0:1784404572.708648:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 12 pid: 6511 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404572.708682:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404572.708689:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f982d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:3647:x1871083728800768:12345-0@lo:103: 00010000:00010000:0.0:1784404572.708702:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404572.708707:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 12 pid: 6511 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708718:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 12 pid: 6511 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708734:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078195ff2/0x24b3e2e6dcd7890c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78905 expref: 12 pid: 6511 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708750:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708759:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784404572.708786:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008450886s 00010000:00010000:0.0:1784404572.708790:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708796:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708801:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708806:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708822:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073933a06 already unused, calling callback (000000000d2bce25) 00010000:00010000:0.0:1784404572.708826:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708832:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708847:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.708883:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404572.708923:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f982d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:3647:x1871083728800768:12345-0@lo:103: Request processed in 234us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404572.708929:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404572.708966:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005ebabb54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728800768:0@lo:103: 00010000:00010000:0.0:1784404572.708989:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.709001:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404572.709006:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073933a06/0x24b3e2e6dcd7893d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1784404572.709731:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1784404572.710448:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1784404572.711017:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1784404572.711126:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1784404572.711253:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1784404572.711644:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1784404572.713985:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1784404572.721884:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784404572.722130:0:6552:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784404572.724222:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784404572.724711:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784404572.725099:0:6496:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784404572.725129:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:1.0:1784404572.725203:0:6551:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1784404572.725206:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1784404572.732714:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404572.734608:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404572.736635:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784404572.737277:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784404572.737308:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784404572.737506:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784404572.737754:0:6496:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1784404572.738428:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000040:00080000:2.0:1784404572.738470:0:6552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:3.0:1784404572.738566:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000004:00080000:2.0:1784404572.738669:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784404572.738674:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1784404572.738706:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1784404572.743480:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1784404572.744244:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1784404572.744423:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1784404572.744589:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1784404572.744716:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1784404572.744910:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784404572.745049:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784404572.745201:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784404572.745328:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784404572.745450:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784404572.745585:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784404572.745743:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784404572.745936:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784404572.746266:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784404572.746423:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784404572.746564:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784404572.746712:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784404572.747447:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1784404572.747927:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784404572.748056:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784404572.748166:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784404572.748273:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784404572.748415:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784404572.749000:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784404572.749142:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784404572.749250:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784404572.749384:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784404572.749708:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784404572.750032:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784404572.750216:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1784404572.753840:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784404572.753911:0:6496:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc2ae01cab988 00100000:10000000:3.0:1784404572.753931:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784404572.759137:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784404572.759166:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784404572.759195:0:6496:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784404572.759254:0:6496:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784404572.763018:0:6496:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404572.763177:0:6496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1784404573.443150:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404574.470273:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404575.491016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404576.519224:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784404577.405662:0:6797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784404577.539937:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784404578.180586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784404578.180601:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784404578.180604:0:37:0:(import.c:65:import_set_state_nolock()) 0000000077afc9b8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404578.180624:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000077afc9b8 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404578.180653:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000044f5c741 x1871083728801024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404578.180801:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044f5c741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728801024:0@lo:38: 00000100:00100000:1.0:1784404578.180919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404578.181279:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404578.181288:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008cda7fed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728800896:0@lo:400: 00000100:00100000:0.0:1784404578.181323:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404578.181404:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728800896 00000100:00100000:2.0:1784404578.181411:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728800896 00000100:00100000:2.0:1784404578.181461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784404578.181469:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8ee7008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:3649:x1871083728800896:12345-0@lo:400: 00000100:00100000:2.0:1784404578.181517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8ee7008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:3649:x1871083728800896:12345-0@lo:400: Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404578.181524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784404578.182171:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801024 00000100:00100000:3.0:1784404578.182178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801024 00000100:00100000:3.0:1784404578.182208:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404578.182213:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000378e732a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083728801024:12345-0@lo:38: 00010000:00080000:3.0:1784404578.182234:0:6521:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1784404578.182271:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x24b3e2e6dcd78944 00000004:00100000:3.0:1784404578.182324:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784404578.182481:0:6521:0:(import.c:65:import_set_state_nolock()) 0000000078016a88 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784404578.182680:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000378e732a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1871083728801024:12345-0@lo:38: Request processed in 465us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404578.182688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784404578.182795:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008cda7fed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728800896:0@lo:400: 00010000:00080000:1.0:1784404578.192457:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000044f5c741 x1871083728801024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404578.192481:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784404578.192490:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784404578.192496:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784404578.192499:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000077afc9b8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784404578.192507:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044f5c741 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728801024:0@lo:38: 00000020:00000004:0.0:1784404578.398452:0:6849:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404578.400123:0:6849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784404578.564807:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404579.586987:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404580.612263:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784404580.739925:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784404580.739933:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd544dfc000 from 3 10000000:01000000:2.0:1784404580.739938:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784404580.739986:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404580.739999:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404580.740010:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404580.740034:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054541f4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728801152:0@lo:101: 00000100:00100000:2.0:1784404580.740102:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404580.740153:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 0000000002934822 going to sleep for 11 seconds 00000100:00100000:3.0:1784404580.740469:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801152 00000100:00100000:3.0:1784404580.740478:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801152 00000100:00100000:3.0:1784404580.740533:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784404580.740543:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000ab38b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6517:x1871083728801152:12345-0@lo:101: 00010000:00010000:3.0:1784404580.740556:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404580.740568:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7894b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404580.740603:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404580.740613:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404580.740628:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006b267e3, rc 0) 00000100:00100000:3.0:1784404580.740675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000ab38b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6517:x1871083728801152:12345-0@lo:101: Request processed in 134us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404580.740681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784404580.741109:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054541f4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728801152:0@lo:101: 00010000:00010000:2.0:1784404580.741126:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404580.741135:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404580.741187:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054541f4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728801280:0@lo:256: 00000100:00100000:2.0:1784404580.741226:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404580.741259:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 0000000002934822 going to sleep for 11 seconds 00000100:00100000:0.0:1784404580.741354:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801280 00000100:00100000:0.0:1784404580.741360:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801280 00000100:00100000:0.0:1784404580.741396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404580.741402:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f287162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6517:x1871083728801280:12345-0@lo:256: 20000000:01000000:0.0:1784404580.741417:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784404580.741433:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784404580.741436:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1784404580.741507:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f287162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6517:x1871083728801280:12345-0@lo:256: Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404580.741514:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404580.741543:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054541f4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728801280:0@lo:256: 10000000:01000000:0.0:1784404580.741584:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784404580.741592:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404580.741600:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1784404581.035534:0:6950:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404581.035769:0:6950:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404581.635785:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404582.659255:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404583.301639:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404583.301665:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ede03a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728801408:0@lo:400: 00000100:00100000:1.0:1784404583.301755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404583.301816:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728801536:0@lo:400: 00000100:00100000:1.0:1784404583.301847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404583.301912:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801408 00000100:00100000:1.0:1784404583.301919:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801408 00000100:00100000:1.0:1784404583.301968:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404583.301976:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ee9504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:3648:x1871083728801408:12345-0@lo:400: 00000100:00100000:1.0:1784404583.302024:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ee9504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:3648:x1871083728801408:12345-0@lo:400: Request processed in 48us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404583.302031:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404583.302070:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801536 00000100:00100000:1.0:1784404583.302074:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801536 00000100:00100000:1.0:1784404583.302113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404583.302120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb99ee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728801536:12345-0@lo:400: 00000100:00100000:1.0:1784404583.302340:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb99ee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728801536:12345-0@lo:400: Request processed in 220us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404583.302347:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784404583.302387:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000065a866ce x1871083728801536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404583.302399:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728801536:0@lo:400: 00000100:00100000:1.0:1784404583.303384:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ede03a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728801408:0@lo:400: 00010000:00010000:1.0:1784404583.683063:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404584.707053:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404585.731198:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404586.756140:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404587.779021:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404588.420976:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000ede03a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728801664:0@lo:400: 00000100:00100000:1.0:1784404588.421049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404588.421668:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801664 00000100:00100000:2.0:1784404588.421687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801664 00000100:00100000:2.0:1784404588.421734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784404588.421743:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a1e8895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:3647:x1871083728801664:12345-0@lo:400: 00000100:00100000:2.0:1784404588.421795:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a1e8895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:3647:x1871083728801664:12345-0@lo:400: Request processed in 54us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404588.421803:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404588.422216:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000ede03a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728801664:0@lo:400: 00000100:00100000:1.0:1784404588.422243:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728801792:0@lo:400: 00000100:00100000:1.0:1784404588.422275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404588.422310:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801792 00000100:00100000:1.0:1784404588.422314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801792 00000100:00100000:1.0:1784404588.422340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404588.422345:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ede03a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728801792:12345-0@lo:400: 00000100:00100000:1.0:1784404588.422381:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ede03a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728801792:12345-0@lo:400: Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404588.422387:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784404588.422417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000065a866ce x1871083728801792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404588.422428:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728801792:0@lo:400: 00010000:00010000:2.0:1784404588.803026:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784404589.740220:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784404589.740224:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1784404589.740226:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784404589.740375:0:7449:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d99f04d2 00000020:01000004:1.0:1784404589.740391:0:7449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1784404589.740402:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784404589.740423:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000c21fa611) 00000020:00000080:1.0:1784404589.740439:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784404589.793010:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1784404589.793084:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1784404589.818364:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784404589.818597:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1784404589.818607:0:7449:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784404589.818620:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd78960 00000020:01000004:3.0:1784404589.818626:0:7449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784404589.818646:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784404589.818650:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784404589.818668:0:7449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1784404589.818694:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1784404589.818698:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:2.0:1784404589.830764:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1784404589.852248:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784404589.852283:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1784404589.852287:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784404589.852289:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784404589.852291:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404589.852292:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404589.852293:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404589.852294:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404589.852296:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784404589.852297:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784404589.852298:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784404589.852299:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404589.852300:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784404589.852303:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1784404589.852306:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784404589.852307:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784404589.852308:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404589.852309:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404589.852313:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404589.852314:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404589.852315:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784404589.852316:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784404589.852317:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784404589.852318:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404589.852318:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784404589.852422:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784404589.852444:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091ae7901 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728801920:0@lo:253: 00000100:00100000:3.0:1784404589.852516:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404589.852637:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f064d21b going to sleep for 11 seconds 00000100:00100000:1.0:1784404589.852733:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728801920 00000100:00100000:1.0:1784404589.852741:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728801920 00000100:00100000:1.0:1784404589.852995:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404589.853004:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c46ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728801920:12345-0@lo:253: 20000000:01000000:1.0:1784404589.853040:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784404589.853045:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1784404589.853049:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1784404589.853052:0:6511:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1784404589.853089:0:6511:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1784404589.853283:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404589.853486:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1784404589.853501:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404589.853519:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1784404589.853537:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1784404589.853554:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1784404589.853608:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1784404589.853617:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1784404589.853632:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1784404589.853638:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1784404589.853651:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1784404589.853671:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1784404589.853687:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1784404589.853704:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1784404589.856015:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1784404589.856049:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404589.856067:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1784404589.856074:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404589.856110:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1784404589.856118:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404589.856131:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1784404589.856136:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784404589.856147:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1784404589.856160:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1784404589.856176:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1784404589.856303:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1784404589.856314:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1784404589.856327:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1784404589.856487:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1784404589.856515:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1784404589.856523:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1784404589.856537:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1784404589.856558:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1784404589.856564:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1784404589.856586:0:6511:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1784404589.856593:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1784404589.857670:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1784404589.858059:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1784404589.858084:0:6511:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.142@tcp for mdt 20000000:01000000:1.0:1784404589.858087:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404589.858103:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1784404589.858109:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784404589.858121:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1784404589.858126:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404589.858143:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1784404589.858151:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1784404589.858164:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1784404589.858180:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1784404589.858227:0:6511:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1784404589.858235:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1784404589.858714:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1784404589.859175:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1784404589.859193:0:6511:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.202.142@tcp for mdt 20000000:01000000:1.0:1784404589.859195:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404589.859209:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1784404589.859215:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404589.859228:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1784404589.859243:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404589.859260:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1784404589.859268:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1784404589.859281:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1784404589.859298:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1784404589.859318:0:6511:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784404589.859320:0:6511:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784404589.859324:0:6511:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784404589.859439:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784404589.859442:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784404589.859735:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1784404589.859756:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1784404589.859772:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1784404589.860170:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1784404589.860190:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1784404589.860203:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1784404589.860211:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784404589.860213:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784404589.860542:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784404589.860562:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784404589.860576:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1784404589.860732:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1784404589.860750:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1784404589.860766:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1784404589.860773:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784404589.860774:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784404589.861196:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784404589.861215:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784404589.861230:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1784404589.861438:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1784404589.861458:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1784404589.861481:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1784404589.861496:0:6511:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784404589.861499:0:6511:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784404589.861504:0:6511:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784404589.861510:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784404589.861963:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1784404589.862074:0:6511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784404589.872038:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784404589.872220:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872242:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872250:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872277:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872283:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872331:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872417:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 12 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404589.872433:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005ebabb54 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1871083728802048:0@lo:104: 00000100:00100000:0.0:1784404589.872500:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404589.872605:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872613:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 12 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404589.872621:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dec9f5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1871083728802176:0@lo:104: 00000100:00100000:0.0:1784404589.872643:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404589.872785:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.872793:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 12 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404589.872801:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4b9da8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1871083728802304:0@lo:104: 00000100:00100000:0.0:1784404589.872923:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404589.873321:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802048 00000100:00100000:3.0:1784404589.873329:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802048 00000100:00100000:3.0:1784404589.873380:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802176 00000100:00100000:3.0:1784404589.873383:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802176 00000100:00100000:3.0:1784404589.873398:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404589.873405:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbdf1aa8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6511:x1871083728802048:12345-0@lo:104: 00010000:00010000:3.0:1784404589.873417:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404589.873476:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404589.873482:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbdf1aa8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6511:x1871083728802048:12345-0@lo:104: Request processed in 77us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404589.873496:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404589.873514:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784404589.873520:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000760d0199 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6511:x1871083728802176:12345-0@lo:104: 00010000:00010000:3.0:1784404589.873527:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404589.873559:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784404589.873564:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000760d0199 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6511:x1871083728802176:12345-0@lo:104: Request processed in 46us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404589.873570:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784404589.873638:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404589.873645:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873653:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002701589e already unused, calling callback (00000000930d9091) 10000000:00010000:2.0:1784404589.873667:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873687:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404589.873694:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404589.873700:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404589.873733:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873740:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404589.873759:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873765:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd78921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78928 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873776:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404589.873778:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873783:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000411eba06 already unused, calling callback (00000000930d9091) 10000000:00010000:2.0:1784404589.873786:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873791:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404589.873796:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404589.873820:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404589.873834:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873840:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404589.873874:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873880:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 00000000411eba06/0x24b3e2e6dcd788b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd788b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.873890:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404589.873892:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404589.873893:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404589.873899:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404589.874155:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set 00000000913daba5 going to sleep for 11 seconds 00000100:00100000:0.0:1784404589.874179:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005ebabb54 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1871083728802048:0@lo:104: 00000100:00100000:0.0:1784404589.874188:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dec9f5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1871083728802176:0@lo:104: 00000100:00100000:1.0:1784404589.874255:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802304 00000100:00100000:1.0:1784404589.874268:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802304 00000100:00100000:0.0:1784404589.874332:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404589.874353:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004f2df4d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728802432:0@lo:103: 00000100:00100000:0.0:1784404589.874384:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404589.874464:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802432 00000100:00100000:2.0:1784404589.874468:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802432 00010000:00010000:2.0:1784404589.874488:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 13 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404589.874517:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784404589.874524:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf231f99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:3648:x1871083728802432:12345-0@lo:103: 00010000:00010000:2.0:1784404589.874534:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404589.874538:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 13 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.874547:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 13 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.874559:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78921 expref: 13 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.874580:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404589.874612:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf231f99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:3648:x1871083728802432:12345-0@lo:103: Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404589.874619:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784404589.874642:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004f2df4d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728802432:0@lo:103: 00000100:00100000:3.0:1784404589.874776:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784404589.874784:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000734e2fb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6511:x1871083728802304:12345-0@lo:104: 00010000:00010000:3.0:1784404589.874792:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404589.874918:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404589.874924:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000734e2fb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6511:x1871083728802304:12345-0@lo:104: Request processed in 142us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404589.874930:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784404589.874994:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404589.874999:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.875006:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003bd2f982 already unused, calling callback (00000000930d9091) 10000000:00010000:2.0:1784404589.875009:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.875015:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404589.875019:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404589.875024:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404589.875047:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.875053:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404589.875060:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.875066:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000003bd2f982/0x24b3e2e6dcd78895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7889c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.875085:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404589.875086:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404589.875088:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404589.875215:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4b9da8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1871083728802304:0@lo:104: 00010000:00010000:0.0:1784404589.875233:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404589.875448:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008514d306 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728802560:0@lo:103: 00000100:00100000:1.0:1784404589.875482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.875555:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404589.875561:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004f2df4d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728802688:0@lo:103: 00000100:00100000:1.0:1784404589.875582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404589.875720:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802560 00000100:00100000:0.0:1784404589.875725:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802560 00010000:00010000:0.0:1784404589.875743:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 12 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404589.875770:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802688 00000100:00100000:0.0:1784404589.875773:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802688 00010000:00010000:0.0:1784404589.875781:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 13 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404589.875793:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784404589.875798:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065a866ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:3646:x1871083728802560:12345-0@lo:103: 00010000:00010000:0.0:1784404589.875816:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404589.875820:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 13 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.875829:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 13 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.875877:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f18930a4/0x24b3e2e6dcd788b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd788b1 expref: 13 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.875890:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404589.875925:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065a866ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:3646:x1871083728802560:12345-0@lo:103: Request processed in 127us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404589.875932:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784404589.875948:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404589.875953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005baa9fdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:3646:x1871083728802688:12345-0@lo:103: 00010000:00010000:0.0:1784404589.875960:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404589.875963:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 11 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.875971:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 11 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.875980:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd7889c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78895 expref: 11 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.875991:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.875998:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876010:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876016:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876028:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876034:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876039:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074cf7ed7 already unused, calling callback (000000000d2bce25) 00010000:00010000:0.0:1784404589.876042:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876048:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876060:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876069:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404589.876090:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005baa9fdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:3646:x1871083728802688:12345-0@lo:103: Request processed in 138us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404589.876096:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1784404589.876114:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876120:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.876125:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd78967 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784404589.876140:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1784404589.876555:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004f2df4d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728802688:0@lo:103: 00000100:00100000:3.0:1784404589.876564:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008514d306 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728802560:0@lo:103: 00000100:00100000:0.0:1784404589.878722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c46ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:7449:x1871083728801920:12345-0@lo:253: Request processed in 25713us (26200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404589.878738:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404589.878829:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091ae7901 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728801920:0@lo:253: 10000000:01000000:1.0:1784404589.878845:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1784404589.878883:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784404589.878885:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784404589.878887:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404589.878888:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1784404589.878889:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404589.878890:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404589.878892:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784404589.878893:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784404589.878894:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404589.878896:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784404589.878916:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d99f04d2 from lustre-MDT0001 10000000:01000000:1.0:1784404589.878946:0:7449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1784404589.878949:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1784404589.878956:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd545b94d40 local copy 10000000:01000000:1.0:1784404589.878960:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784404589.878993:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.879003:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.879011:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404589.879030:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728802816:0@lo:101: 00000100:00100000:1.0:1784404589.879076:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.879107:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000052c9516d going to sleep for 11 seconds 00000100:00100000:2.0:1784404589.879319:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802816 00000100:00100000:2.0:1784404589.879326:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802816 00000100:00100000:2.0:1784404589.879378:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784404589.879386:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005e98524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:7449:x1871083728802816:12345-0@lo:101: 00010000:00010000:2.0:1784404589.879398:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404589.879410:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7896e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.879431:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7896e expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.879440:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7896e expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404589.879448:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6f58c6f, rc 0) 00000100:00100000:2.0:1784404589.879487:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005e98524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:7449:x1871083728802816:12345-0@lo:101: Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404589.879494:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404589.879638:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728802816:0@lo:101: 00010000:00010000:1.0:1784404589.879650:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.879669:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404589.879749:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728802944:0@lo:501: 00000100:00100000:1.0:1784404589.879772:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.879792:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000052c9516d going to sleep for 11 seconds 00000100:00100000:0.0:1784404589.879839:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728802944 00000100:00100000:0.0:1784404589.879844:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728802944 00000100:00100000:0.0:1784404589.879896:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784404589.879902:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055a67e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:7449:x1871083728802944:12345-0@lo:501: 00000100:00100000:0.0:1784404589.879964:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055a67e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:7449:x1871083728802944:12345-0@lo:501: Request processed in 63us (192us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784404589.879971:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784404589.880098:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728802944:0@lo:501: 10000000:01000000:1.0:1784404589.880110:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784404589.880126:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784404589.880131:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.880138:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.880144:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.880167:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784404589.880189:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd565e88000 10000000:01000000:1.0:1784404589.880194:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784404589.880198:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dd545b94d40 10000000:01000000:1.0:1784404589.880208:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784404589.880211:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dd545b94d40 from 1 10000000:01000000:1.0:1784404589.880214:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784404589.880229:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000002f2ebbaa/0x24b3e2e6dcd7897c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.880236:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000002f2ebbaa/0x24b3e2e6dcd7897c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.880243:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000002f2ebbaa/0x24b3e2e6dcd7897c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404589.880253:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803072:0@lo:101: 00000100:00100000:1.0:1784404589.880276:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.880293:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef79ba77 going to sleep for 11 seconds 00000100:00100000:0.0:1784404589.880337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803072 00000100:00100000:0.0:1784404589.880342:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803072 00000100:00100000:0.0:1784404589.880382:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784404589.880388:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc74947e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:7449:x1871083728803072:12345-0@lo:101: 00010000:00010000:0.0:1784404589.880395:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404589.880404:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0840cbc/0x24b3e2e6dcd78983 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7897c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880418:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0840cbc/0x24b3e2e6dcd78983 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7897c expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880425:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0840cbc/0x24b3e2e6dcd78983 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7897c expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880431:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0840cbc, rc 0) 00000100:00100000:0.0:1784404589.880457:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc74947e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:7449:x1871083728803072:12345-0@lo:101: Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404589.880463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1784404589.880484:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404589.880494:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880501:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d8ecae3b already unused, calling callback (00000000930d9091) 10000000:00010000:0.0:1784404589.880504:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880510:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404589.880516:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404589.880521:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404589.880538:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880544:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404589.880559:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880565:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd7896e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78975 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880580:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404589.880582:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404589.880583:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404589.880590:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404589.880599:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4b9da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728803200:0@lo:103: 00000100:00100000:0.0:1784404589.880623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404589.880648:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803200 00000100:00100000:0.0:1784404589.880669:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803200 00000100:00100000:0.0:1784404589.880701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404589.880707:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dec9f5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:3649:x1871083728803200:12345-0@lo:103: 00010000:00010000:0.0:1784404589.880716:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404589.880726:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b6f58c6f/0x24b3e2e6dcd78975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7896e expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404589.880738:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404589.880764:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dec9f5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:3649:x1871083728803200:12345-0@lo:103: Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404589.880770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404589.880795:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4b9da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728803200:0@lo:103: 00000100:00100000:1.0:1784404589.881059:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803072:0@lo:101: 00010000:00010000:1.0:1784404589.881070:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000002f2ebbaa/0x24b3e2e6dcd7897c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78983 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881078:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000002f2ebbaa/0x24b3e2e6dcd7897c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78983 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404589.881091:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784404589.881106:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000002f2ebbaa/0x24b3e2e6dcd7897c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78983 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881112:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000002f2ebbaa/0x24b3e2e6dcd7897c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78983 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404589.881121:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd565e88000 10000000:01000000:1.0:1784404589.881130:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784404589.881133:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dd565e88000 from 1 10000000:01000000:1.0:1784404589.881135:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784404589.881150:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000005d21105a/0x24b3e2e6dcd7898a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881156:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000005d21105a/0x24b3e2e6dcd7898a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881161:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000005d21105a/0x24b3e2e6dcd7898a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404589.881173:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803328:0@lo:101: 00000100:00100000:1.0:1784404589.881198:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.881225:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef79ba77 going to sleep for 11 seconds 00000100:00100000:1.0:1784404589.881239:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803328 00000100:00100000:1.0:1784404589.881242:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803328 00000100:00100000:1.0:1784404589.881265:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404589.881271:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f30f9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:7449:x1871083728803328:12345-0@lo:101: 00010000:00010000:1.0:1784404589.881279:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404589.881287:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ed59695/0x24b3e2e6dcd78991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7898a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881300:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ed59695/0x24b3e2e6dcd78991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7898a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881307:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ed59695/0x24b3e2e6dcd78991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7898a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881314:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ed59695, rc 0) 00000100:00100000:1.0:1784404589.881409:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f30f9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:7449:x1871083728803328:12345-0@lo:101: Request processed in 138us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404589.881415:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404589.881440:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803328:0@lo:101: 00010000:00010000:1.0:1784404589.881449:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000005d21105a/0x24b3e2e6dcd7898a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881456:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000005d21105a/0x24b3e2e6dcd7898a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404589.881465:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784404589.881468:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000005d21105a/0x24b3e2e6dcd7898a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881473:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000005d21105a/0x24b3e2e6dcd7898a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404589.881478:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1784404589.881481:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784404589.881485:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd565e88000 10000000:01000000:1.0:1784404589.881487:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784404589.881489:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1784404589.881491:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784404589.881503:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000ff12b57d/0x24b3e2e6dcd78998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881509:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000ff12b57d/0x24b3e2e6dcd78998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881515:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000ff12b57d/0x24b3e2e6dcd78998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404589.881532:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803456:0@lo:101: 00000100:00100000:1.0:1784404589.881555:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.881564:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef79ba77 going to sleep for 11 seconds 00000100:00100000:1.0:1784404589.881583:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803456 00000100:00100000:1.0:1784404589.881587:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803456 00000100:00100000:1.0:1784404589.881603:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404589.881608:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077aae9a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:7449:x1871083728803456:12345-0@lo:101: 00010000:00010000:1.0:1784404589.881614:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404589.881620:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f08a07d2/0x24b3e2e6dcd7899f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78998 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881632:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f08a07d2/0x24b3e2e6dcd7899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881639:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f08a07d2/0x24b3e2e6dcd7899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881645:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f08a07d2, rc 0) 00000100:00100000:1.0:1784404589.881685:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077aae9a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803456:12345-0@lo:101: Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404589.881691:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404589.881712:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803456:0@lo:101: 00010000:00010000:1.0:1784404589.881720:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000ff12b57d/0x24b3e2e6dcd78998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404589.881727:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000ff12b57d/0x24b3e2e6dcd78998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404589.881804:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803584:0@lo:501: 00000100:00100000:1.0:1784404589.881969:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.882023:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef79ba77 going to sleep for 11 seconds 00000100:00100000:1.0:1784404589.882041:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803584 00000100:00100000:1.0:1784404589.882044:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803584 00000100:00100000:0.0:1784404589.882269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784404589.882277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca1063a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803584:12345-0@lo:501: 00000100:00100000:0.0:1784404589.882389:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca1063a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803584:12345-0@lo:501: Request processed in 114us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404589.882396:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784404589.882540:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803584:0@lo:501: 00000100:00100000:1.0:1784404589.882569:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803712:0@lo:503: 00000100:00100000:1.0:1784404589.882607:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.882615:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef79ba77 going to sleep for 11 seconds 00000100:00100000:1.0:1784404589.882627:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803712 00000100:00100000:1.0:1784404589.882630:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803712 00000100:00100000:1.0:1784404589.882648:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784404589.882653:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000692d90c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803712:12345-0@lo:503: 00000100:00100000:1.0:1784404589.882733:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000692d90c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803712:12345-0@lo:503: Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404589.882740:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784404589.882767:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803712:0@lo:503: 00000040:00080000:1.0:1784404589.883148:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784404589.883218:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803840:0@lo:502: 00000100:00100000:1.0:1784404589.883252:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.883309:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef79ba77 going to sleep for 11 seconds 00000100:00100000:1.0:1784404589.883329:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803840 00000100:00100000:1.0:1784404589.883333:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803840 00000100:00100000:1.0:1784404589.883361:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784404589.883366:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002859187e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803840:12345-0@lo:502: 00000100:00100000:1.0:1784404589.883449:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002859187e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803840:12345-0@lo:502: Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404589.883456:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784404589.883486:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803840:0@lo:502: 00000040:00080000:1.0:1784404589.883681:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784404589.883703:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1784404589.883715:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1784404589.883726:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1784404589.883736:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1784404589.883762:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1784404589.883776:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1784404589.883787:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1784404589.883798:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1784404589.883825:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1784404589.883840:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1784404589.883878:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1784404589.883894:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1784404589.883906:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1784404589.883918:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1784404589.883931:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1784404589.883944:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1784404589.883957:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1784404589.883969:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1784404589.883981:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1784404589.883995:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1784404589.884021:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1784404589.884035:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1784404589.884055:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803968:0@lo:502: 00000100:00100000:1.0:1784404589.884093:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404589.884109:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef79ba77 going to sleep for 11 seconds 00000100:00100000:1.0:1784404589.884136:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728803968 00000100:00100000:1.0:1784404589.884139:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728803968 00000100:00100000:1.0:1784404589.884160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404589.884165:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a47fe05c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803968:12345-0@lo:502: 00000100:00100000:1.0:1784404589.884237:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a47fe05c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728803968:12345-0@lo:502: Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404589.884244:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404589.884274:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266dafec pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728803968:0@lo:502: 00000040:00080000:1.0:1784404589.884306:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1784404589.884314:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1784404589.885226:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404589.885239:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404589.885241:0:7461:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784404589.885247:0:7461:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1784404589.885250:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784404589.885264:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000d65f097f) 00000020:00000080:1.0:1784404589.885280:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1784404589.885285:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784404589.885434:0:7461:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784404589.885441:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd789ad 00000020:00000080:1.0:1784404589.885647:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1784404589.885652:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404589.885667:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404589.885669:0:7461:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784404589.885672:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404589.885676:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404589.885677:0:7461:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1784404589.885681:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784404589.885688:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000037c65a5e) 00000020:00000080:1.0:1784404589.885698:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1784404589.885702:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784404589.885709:0:7461:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1784404589.885712:0:7461:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1784404589.885718:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784404589.885773:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d99f04d2 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1784404589.885785:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000851793c9) 00000020:00000080:1.0:1784404589.885793:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1784404589.886106:0:7461:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784404589.886112:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd789c2 00000020:00000080:1.0:1784404589.886216:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1784404589.886224:0:7461:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784404589.886228:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x24b3e2e6dcd789c9 00080000:01000000:1.0:1784404589.886234:0:7461:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784404589.886237:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd789d0 00080000:10000000:1.0:1784404589.886705:0:7461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1784404589.887113:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1784404589.983015:0:7461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1784404589.983280:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1784404589.987347:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1784404589.987741:0:7461:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784404589.998946:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1784404589.998961:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404589.998968:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404589.998977:0:7461:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1784404589.998983:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404589.998989:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404589.998990:0:7461:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1784404589.998992:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784404589.998996:0:7461:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:2.0:1784404589.999023:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404589.999037:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000003fcd4950) 00000020:00000080:2.0:1784404589.999056:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1784404589.999061:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784404589.999148:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1784404589.999154:0:7461:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784404589.999160:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd789de 00010000:00080000:2.0:1784404589.999189:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000033ece47e@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404590.001356:0:7461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1784404590.007060:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784404590.007076:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784404590.007114:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784404590.007149:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd789e5 00000100:00080000:3.0:1784404590.007160:0:7461:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784404590.007175:0:7461:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000033ece47e using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404590.007217:0:7461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a4c234bb x1871083728804096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404590.007287:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a4c234bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728804096:0@lo:38: 00000100:00100000:0.0:1784404590.007368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784404590.007490:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1784404590.007542:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404590.007547:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404590.007548:0:7461:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1784404590.007551:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784404590.007553:0:7461:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784404590.007555:0:7461:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784404590.007556:0:7461:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784404590.007557:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784404590.007560:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404590.007561:0:7461:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784404590.007563:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404590.007567:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404590.007568:0:7461:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1784404590.007572:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784404590.007601:0:7461:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784404590.007614:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404590.007617:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404590.007618:0:7461:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1784404590.007621:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404590.007623:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404590.007624:0:7461:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784404590.007627:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784404590.007628:0:7461:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784404590.007653:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404590.007666:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404590.007667:0:7461:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784404590.007670:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1784404590.007899:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804096 00000100:00100000:2.0:1784404590.007908:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804096 00000100:00100000:2.0:1784404590.007942:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784404590.007948:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f4b9da8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728804096:12345-0@lo:38: 00010000:00080000:2.0:1784404590.007968:0:6524:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:2.0:1784404590.007997:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd789ec 00000004:00100000:2.0:1784404590.008010:0:6524:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784404590.008015:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1784404590.008114:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1784404590.008144:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784404590.008157:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000ff12b57d/0x24b3e2e6dcd78998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.008168:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000ff12b57d/0x24b3e2e6dcd78998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404590.008189:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd565e88000 from 1 10000000:01000000:2.0:1784404590.008192:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784404590.008230:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.008238:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.008245:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404590.008260:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b2f9b3e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804352:0@lo:101: 00000100:00100000:2.0:1784404590.008299:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404590.008325:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b6aecad8 going to sleep for 11 seconds 00000100:00100000:2.0:1784404590.008355:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000024b28c5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728804224:0@lo:400: 00000100:00100000:2.0:1784404590.008399:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404590.009589:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804352 00000100:00100000:0.0:1784404590.009597:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804352 00000100:00100000:0.0:1784404590.009638:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784404590.009645:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000260d4c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:7449:x1871083728804352:12345-0@lo:101: 00010000:00010000:0.0:1784404590.009667:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404590.009679:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd789f3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.009725:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.009734:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.009743:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074cf7ed7, rc 0) 00000100:00100000:0.0:1784404590.009942:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000260d4c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7449:x1871083728804352:12345-0@lo:101: Request processed in 296us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.009948:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784404590.010442:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804224 00000100:00100000:1.0:1784404590.010447:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804224 00000100:00100000:1.0:1784404590.010486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404590.010493:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d560dcb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728804224:12345-0@lo:400: 00000100:00100000:1.0:1784404590.010559:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d560dcb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728804224:12345-0@lo:400: Request processed in 66us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404590.010566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784404590.010708:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000024b28c5d x1871083728804224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404590.010724:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000024b28c5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728804224:0@lo:400: 00000100:00080000:2.0:1784404590.013001:0:6524:0:(import.c:65:import_set_state_nolock()) 0000000072f61c20 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404590.013098:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f4b9da8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083728804096:12345-0@lo:38: Request processed in 5148us (5729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.013109:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404590.013268:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784404590.013278:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784404590.013286:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784404590.013291:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784404590.013293:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000033ece47e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784404590.013312:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a4c234bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728804096:0@lo:38: 00000100:00100000:1.0:1784404590.013543:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000024b28c5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728804480:0@lo:41: 00000100:00100000:1.0:1784404590.013587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404590.013675:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804480 00000100:00100000:2.0:1784404590.013682:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804480 00000100:00100000:2.0:1784404590.013721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784404590.013730:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000266dafec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1871083728804480:12345-0@lo:41: 00000004:00000024:2.0:1784404590.013763:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1784404590.013798:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000266dafec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1871083728804480:12345-0@lo:41: Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.013803:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404590.015146:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b2f9b3e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804352:0@lo:101: 00010000:00010000:3.0:1784404590.015346:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404590.015358:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404590.015875:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000024b28c5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728804480:0@lo:41: 00000100:00100000:3.0:1784404590.016103:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b46541de pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804608:0@lo:256: 00000100:00100000:3.0:1784404590.016156:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404590.016342:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000008718f8a7 going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.016413:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804608 00000100:00100000:0.0:1784404590.016419:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804608 00000100:00100000:0.0:1784404590.016493:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784404590.016501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d418cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7449:x1871083728804608:12345-0@lo:256: 20000000:01000000:0.0:1784404590.016517:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784404590.016530:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784404590.016532:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1784404590.016617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d418cba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7449:x1871083728804608:12345-0@lo:256: Request processed in 116us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.016624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784404590.016635:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b46541de pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804608:0@lo:256: 10000000:01000000:3.0:1784404590.017474:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784404590.017492:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404590.017503:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404590.017513:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd565e88000 from 1 10000000:01000000:3.0:1784404590.017516:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784404590.017548:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404590.017553:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404590.017559:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404590.017572:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b46541de pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804736:0@lo:101: 00000100:00100000:3.0:1784404590.019345:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404590.019392:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000008718f8a7 going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.019496:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804736 00000100:00100000:0.0:1784404590.019557:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804736 00000100:00100000:0.0:1784404590.019605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784404590.019612:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003589fd56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7449:x1871083728804736:12345-0@lo:101: 00010000:00010000:0.0:1784404590.019625:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404590.019638:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78a01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.019769:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.019778:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.019785:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e986e92, rc 0) 00000100:00100000:0.0:1784404590.019828:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003589fd56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7449:x1871083728804736:12345-0@lo:101: Request processed in 217us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.019835:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404590.020103:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b46541de pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804736:0@lo:101: 00010000:00010000:1.0:1784404590.020118:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.020141:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404590.020251:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000830eca2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804864:0@lo:501: 00000100:00100000:1.0:1784404590.020282:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.020299:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000061d2a4c4 going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.020350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804864 00000100:00100000:0.0:1784404590.020354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804864 00000100:00100000:0.0:1784404590.020375:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784404590.020379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb68ef7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7449:x1871083728804864:12345-0@lo:501: 00000100:00100000:0.0:1784404590.020464:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb68ef7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7449:x1871083728804864:12345-0@lo:501: Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.020470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784404590.020489:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000830eca2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804864:0@lo:501: 00000100:00100000:3.0:1784404590.020517:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804992:0@lo:503: 00000100:00100000:3.0:1784404590.020554:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404590.020574:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000160a1c62 going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.020759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728804992 00000100:00100000:0.0:1784404590.020764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728804992 00000100:00100000:0.0:1784404590.020800:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784404590.020816:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055c61ef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7449:x1871083728804992:12345-0@lo:503: 00000040:00080000:0.0:1784404590.021336:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784404590.021517:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055c61ef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7449:x1871083728804992:12345-0@lo:503: Request processed in 711us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.021524:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784404590.021587:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728804992:0@lo:503: 00000040:00080000:3.0:1784404590.021974:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404590.022012:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1784404590.022285:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404590.023428:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1784404590.023622:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1784404590.023642:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784404590.023664:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.023677:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404590.023726:0:7449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784404590.023729:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd565e88000 10000000:01000000:1.0:1784404590.023732:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd565e88000 10000000:01000000:1.0:1784404590.023736:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784404590.023741:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd565e88000 from 1 10000000:01000000:1.0:1784404590.023744:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784404590.023775:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000a7f37c17/0x24b3e2e6dcd78a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.023783:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000a7f37c17/0x24b3e2e6dcd78a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.023791:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000a7f37c17/0x24b3e2e6dcd78a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404590.024004:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000093d23846 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805120:0@lo:101: 00000100:00100000:1.0:1784404590.024280:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.024324:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055d3beea going to sleep for 11 seconds 00000100:00100000:2.0:1784404590.024383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728805120 00000100:00100000:2.0:1784404590.024391:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728805120 00000100:00100000:2.0:1784404590.024441:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784404590.024448:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb8b584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7449:x1871083728805120:12345-0@lo:101: 00010000:00010000:2.0:1784404590.024458:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404590.024467:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d109bda6/0x24b3e2e6dcd78a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78a0f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.024484:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d109bda6/0x24b3e2e6dcd78a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.024491:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d109bda6/0x24b3e2e6dcd78a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.024496:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d109bda6, rc 0) 00000100:00100000:2.0:1784404590.024533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb8b584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805120:12345-0@lo:101: Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.024540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784404590.024571:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000093d23846 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805120:0@lo:101: 00010000:00010000:1.0:1784404590.024585:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000a7f37c17/0x24b3e2e6dcd78a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.024592:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000a7f37c17/0x24b3e2e6dcd78a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404590.024686:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000093d23846 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805248:0@lo:501: 00000100:00100000:1.0:1784404590.024710:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.024736:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055d3beea going to sleep for 11 seconds 00000100:00100000:2.0:1784404590.024828:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728805248 00000100:00100000:2.0:1784404590.024832:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728805248 00000100:00100000:2.0:1784404590.024888:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784404590.024895:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000125c2e4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805248:12345-0@lo:501: 00000100:00100000:2.0:1784404590.024997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000125c2e4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805248:12345-0@lo:501: Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.025016:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784404590.025035:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000093d23846 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805248:0@lo:501: 00000100:00100000:3.0:1784404590.025062:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805376:0@lo:503: 00000100:00100000:3.0:1784404590.025116:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.025131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728805376 00000100:00100000:1.0:1784404590.025135:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728805376 00000100:00100000:3.0:1784404590.025141:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000092f4819a going to sleep for 11 seconds 00000100:00100000:1.0:1784404590.025164:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784404590.025170:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cce2f500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805376:12345-0@lo:503: 00000100:00100000:1.0:1784404590.025248:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cce2f500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805376:12345-0@lo:503: Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404590.025254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784404590.025371:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805376:0@lo:503: 00000040:00080000:3.0:1784404590.025771:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784404590.026009:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805504:0@lo:502: 00000100:00100000:3.0:1784404590.026292:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404590.026325:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000092f4819a going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.026342:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728805504 00000100:00100000:0.0:1784404590.026348:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728805504 00000100:00100000:0.0:1784404590.026387:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784404590.026394:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bedfb21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805504:12345-0@lo:502: 00000100:00100000:0.0:1784404590.026482:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bedfb21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805504:12345-0@lo:502: Request processed in 88us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.026489:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784404590.026507:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805504:0@lo:502: 00000040:00080000:3.0:1784404590.026718:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784404590.026744:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784404590.026758:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784404590.026772:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784404590.026797:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784404590.026826:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784404590.026997:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784404590.027013:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784404590.027281:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784404590.027301:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784404590.027316:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784404590.027331:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784404590.027412:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784404590.027435:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784404590.027448:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784404590.027462:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784404590.027476:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784404590.027487:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784404590.027499:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784404590.027510:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784404590.027523:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784404590.027534:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784404590.027545:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784404590.027556:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784404590.027567:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1784404590.027579:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1784404590.027591:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1784404590.027603:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1784404590.027635:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805632:0@lo:502: 00000100:00100000:3.0:1784404590.027694:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404590.028322:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000092f4819a going to sleep for 11 seconds 00000100:00100000:1.0:1784404590.030293:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728805632 00000100:00100000:1.0:1784404590.030307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728805632 00000100:00100000:1.0:1784404590.030410:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784404590.030420:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017ed0766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805632:12345-0@lo:502: 00000100:00100000:1.0:1784404590.030597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017ed0766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805632:12345-0@lo:502: Request processed in 179us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404590.030614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784404590.030725:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b5365f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805632:0@lo:502: 00000040:00080000:2.0:1784404590.030821:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1784404590.030834:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1784404590.031218:0:7467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1784404590.031240:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000770aac64) 00000020:00000080:2.0:1784404590.031260:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1784404590.031424:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d99f04d2 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784404590.031428:0:7467:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d99f04d2 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784404590.031431:0:7467:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d99f04d2 3 00010000:00080000:2.0:1784404590.031460:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bdbad435@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404590.033043:0:7467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1784404590.033159:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1784404590.033196:0:7467:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784404590.033209:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x24b3e2e6dcd78a24 00000100:00080000:2.0:1784404590.033218:0:7467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404590.033222:0:7467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000bdbad435 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404590.033254:0:7467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db381dde x1871083728805760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404590.033286:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784404590.034153:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db381dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728805760:0@lo:38: 00000100:00100000:0.0:1784404590.034224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404590.035107:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728805760 00000100:00100000:2.0:1784404590.035117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728805760 00000100:00100000:2.0:1784404590.035876:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784404590.035883:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ebabb54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1871083728805760:12345-0@lo:38: 00010000:00080000:2.0:1784404590.035911:0:6520:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:2.0:1784404590.035956:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x24b3e2e6dcd78a2b 00000004:00100000:2.0:1784404590.035973:0:6520:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784404590.036008:0:6520:0:(import.c:65:import_set_state_nolock()) 000000006d6ca4d5 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404590.036085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ebabb54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1871083728805760:12345-0@lo:38: Request processed in 202us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.036092:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784404590.036362:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000db381dde x1871083728805760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404590.036374:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404590.036382:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784404590.036389:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784404590.036394:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784404590.036396:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000bdbad435 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784404590.037372:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db381dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728805760:0@lo:38: 00000040:00080000:2.0:1784404590.037490:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1784404590.037539:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1784404590.037572:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784404590.037586:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000a7f37c17/0x24b3e2e6dcd78a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.037598:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000a7f37c17/0x24b3e2e6dcd78a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784404590.037650:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784404590.037653:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784404590.037665:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404590.037667:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404590.037668:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404590.037669:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404590.037671:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404590.037672:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784404590.037673:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784404590.037681:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404590.037682:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404590.037685:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1784404590.037688:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784404590.037689:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784404590.037690:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404590.037691:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404590.037692:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404590.037693:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404590.037693:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404590.037694:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784404590.037695:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784404590.037696:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404590.037696:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404590.037718:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784404590.037735:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db381dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805888:0@lo:253: 00000100:00100000:2.0:1784404590.037924:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404590.037955:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 0000000047fda12c going to sleep for 11 seconds 00000100:00100000:2.0:1784404590.037979:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728805888 00000100:00100000:2.0:1784404590.037984:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728805888 00000100:00100000:2.0:1784404590.038021:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404590.038027:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3a7a045 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:7449:x1871083728805888:12345-0@lo:253: 20000000:01000000:2.0:1784404590.038053:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784404590.038065:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:3.0:1784404590.039424:0:7468:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:0.0:1784404590.041722:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1784404590.044576:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784404590.044625:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784404590.045070:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784404590.045076:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784404590.045095:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.045113:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.045119:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.045125:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.045162:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.045187:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 15 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404590.045200:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e5526176 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728806016:0@lo:104: 00000100:00100000:0.0:1784404590.045261:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404590.045509:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.045517:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 15 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404590.045525:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd3eb4f3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728806144:0@lo:104: 00000100:00100000:0.0:1784404590.045546:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404590.045569:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a6e613ec going to sleep for 11 seconds 00000100:00100000:3.0:1784404590.045630:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806016 00000100:00100000:3.0:1784404590.045638:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806016 00000100:00100000:3.0:1784404590.045692:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806144 00000100:00100000:3.0:1784404590.045696:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806144 00000100:00100000:3.0:1784404590.045711:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784404590.045718:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a593d027 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6535:x1871083728806016:12345-0@lo:104: 00010000:00010000:3.0:1784404590.045728:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404590.045800:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404590.045806:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a593d027 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6535:x1871083728806016:12345-0@lo:104: Request processed in 89us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404590.045813:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784404590.045830:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404590.045835:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d078f189 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728806144:12345-0@lo:104: 00010000:00010000:3.0:1784404590.045842:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404590.045939:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784404590.045943:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d078f189 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728806144:12345-0@lo:104: Request processed in 109us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404590.045949:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784404590.046105:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e5526176 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728806016:0@lo:104: 00000100:00100000:0.0:1784404590.046114:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd3eb4f3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728806144:0@lo:104: 00010000:00010000:0.0:1784404590.046131:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046148:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404590.046153:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046159:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002701589e already unused, calling callback (00000000930d9091) 10000000:00010000:0.0:1784404590.046162:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046169:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404590.046183:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404590.046188:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404590.046224:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046231:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404590.046256:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046263:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000002701589e/0x24b3e2e6dcd789f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd789fa expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046284:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404590.046287:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046293:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000675ff63b already unused, calling callback (00000000930d9091) 10000000:00010000:0.0:1784404590.046295:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046301:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404590.046306:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404590.046311:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1784404590.046316:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404590.046327:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd3eb4f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728806272:0@lo:103: 00010000:00010000:0.0:1784404590.046332:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046337:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404590.046361:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404590.046367:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 00000000675ff63b/0x24b3e2e6dcd7894b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78952 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404590.046371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404590.046381:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404590.046382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404590.046383:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404590.046392:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e5526176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728806400:0@lo:103: 00000100:00100000:1.0:1784404590.046405:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806272 00000100:00100000:1.0:1784404590.046409:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806272 00010000:00010000:1.0:1784404590.046426:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 16 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404590.046448:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404590.046454:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d18ef9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:3646:x1871083728806272:12345-0@lo:103: 00010000:00010000:1.0:1784404590.046464:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404590.046468:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 16 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046477:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 16 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046487:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074cf7ed7/0x24b3e2e6dcd789fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd789f3 expref: 16 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046498:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404590.046523:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d18ef9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3646:x1871083728806272:12345-0@lo:103: Request processed in 70us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404590.046529:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404590.046563:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd3eb4f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728806272:0@lo:103: 00000100:00100000:0.0:1784404590.046603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.046685:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806400 00000100:00100000:1.0:1784404590.046689:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806400 00010000:00010000:1.0:1784404590.046706:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 15 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404590.046734:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404590.046739:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7ae764d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3648:x1871083728806400:12345-0@lo:103: 00010000:00010000:1.0:1784404590.046746:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404590.046749:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 15 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046756:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 15 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046765:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000006b267e3/0x24b3e2e6dcd78952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7894b expref: 15 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046777:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046784:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784404590.046797:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008450886s 00010000:00010000:1.0:1784404590.046800:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046806:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046812:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.046817:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404590.046891:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3a7a045 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7449:x1871083728805888:12345-0@lo:253: Request processed in 8863us (8967us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.046900:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1784404590.046932:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404590.046993:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db381dde pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7449:1871083728805888:0@lo:253: 10000000:01000000:0.0:1784404590.047007:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1784404590.047010:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784404590.047012:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784404590.047013:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784404590.047014:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784404590.047015:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784404590.047016:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784404590.047017:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784404590.047019:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784404590.047020:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784404590.047021:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784404590.047023:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784404590.047033:0:7449:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1784404590.047186:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048dc8739 already unused, calling callback (000000000d2bce25) 00010000:00010000:1.0:1784404590.047191:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.047199:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.047337:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404590.047348:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404590.047380:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7ae764d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:3648:x1871083728806400:12345-0@lo:103: Request processed in 641us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404590.047386:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404590.047430:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e5526176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728806400:0@lo:103: 00010000:00010000:2.0:1784404590.048617:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.048629:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404590.048653:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000048dc8739/0x24b3e2e6dcd78a32 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1784404590.054295:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1784404590.055081:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784404590.055336:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1784404590.055687:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1784404590.056310:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1784404590.056468:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1784404590.058583:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1784404590.059307:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1784404590.059713:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1784404590.059995:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1784404590.060168:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1784404590.060373:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1784404590.062587:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1784404590.062664:0:7472:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1784404590.062669:0:7472:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1784404590.063202:0:7473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1784404590.063256:0:7473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000340bfb61 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1871083728806528:0@lo:700: 00000100:00100000:0.0:1784404590.063322:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404590.063510:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806528 00000100:00100000:3.0:1784404590.063518:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806528 00000100:00100000:3.0:1784404590.063571:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404590.063580:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000051bdb19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1871083728806528:12345-0@lo:700: 00000040:01000000:1.0:1784404590.063776:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1784404590.064299:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002163b157 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728806656:0@lo:1000: 00000100:00100000:3.0:1784404590.064347:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1784404590.064918:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1784404590.065042:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784404590.065962:0:7449:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784404590.065973:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1784404590.066142:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784404590.066532:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set 0000000036623439 going to sleep for 11 seconds 00000100:00100000:1.0:1784404590.067221:0:7473:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097547f6b going to sleep for 11 seconds 40000000:02000000:3.0:1784404590.068936:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1784404590.069566:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806656 00000100:00100000:2.0:1784404590.069576:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806656 00000100:00100000:2.0:1784404590.069625:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784404590.069634:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f832da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728806656:12345-0@lo:1000: 00000100:00100000:2.0:1784404590.070725:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f832da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728806656:12345-0@lo:1000: Request processed in 1088us (6373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.070736:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1784404590.071354:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784404590.076200:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784404590.076259:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1784404590.076995:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784404590.077233:0:7449:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784404590.081542:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784404590.082005:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1784404590.082162:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1784404590.082295:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:0.0:1784404590.083039:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002163b157 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728806656:0@lo:1000: 00000040:01000000:0.0:1784404590.083230:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1784404590.083278:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ac7cdc9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728806784:0@lo:700: 00000100:00100000:0.0:1784404590.083339:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404590.083383:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806784 00000100:00100000:0.0:1784404590.083390:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806784 00000100:00100000:0.0:1784404590.083443:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404590.083451:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000549a4a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728806784:12345-0@lo:700: 00000100:00100000:0.0:1784404590.083502:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000549a4a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728806784:12345-0@lo:700: Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.083510:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404590.083543:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075a62f16 going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.083557:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ac7cdc9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728806784:0@lo:700: 00000100:00100000:0.0:1784404590.083603:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ac7cdc9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1871083728806912:0@lo:900: 00000100:00100000:0.0:1784404590.083629:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404590.083666:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075a62f16 going to sleep for 11 seconds 00100000:10000000:2.0:1784404590.084068:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1784404590.084239:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000100:00100000:1.0:1784404590.084736:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728806912 00000100:00100000:1.0:1784404590.084743:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728806912 00000100:00100000:1.0:1784404590.084786:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404590.084794:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3179c28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1871083728806912:12345-0@lo:900: 00000100:00100000:3.0:1784404590.084880:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000051bdb19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7473:x1871083728806528:12345-0@lo:700: Request processed in 21301us (21557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404590.084889:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784404590.085040:0:7473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000340bfb61 x1871083728806528/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784404606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404590.085054:0:7473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000340bfb61 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1871083728806528:0@lo:700: 40000000:02000000:3.0:1784404590.085064:0:7473:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:1.0:1784404590.085220:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3179c28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1871083728806912:12345-0@lo:900: Request processed in 426us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404590.085234:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1784404590.085688:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00010000:00080000:0.0:1784404590.085688:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ac7cdc9f x1871083728806912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784404606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404590.085699:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ac7cdc9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1871083728806912:0@lo:900: 00000100:00100000:0.0:1784404590.085803:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ac7cdc9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728807040:0@lo:1000: 00100000:10000000:2.0:1784404590.085927:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1784404590.086084:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1784404590.086219:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1784404590.086360:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:1.0:1784404590.086363:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.086405:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad44dfe3 going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.086456:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728807040 00000100:00100000:0.0:1784404590.086462:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728807040 00000100:00100000:0.0:1784404590.086514:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404590.086522:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f982d4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728807040:12345-0@lo:1000: 00000100:00100000:0.0:1784404590.086590:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f982d4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728807040:12345-0@lo:1000: Request processed in 70us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404590.086597:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404590.086672:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ac7cdc9f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728807040:0@lo:1000: 00000004:00080000:1.0:1784404590.086715:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000075a62f16 with version 0 00000020:00100000:1.0:1784404590.086731:0:7474:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784404590.086737:0:7474:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000065a866ce x1871083728807296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404590.086751:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728807296:0@lo:1000: 00000100:00100000:1.0:1784404590.086777:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.086799:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d0f3806 going to sleep for 11 seconds 00000100:00100000:0.0:1784404590.087070:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728807296 00000100:00100000:0.0:1784404590.087075:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728807296 00000100:00100000:0.0:1784404590.087106:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784404590.087113:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005baa9fdf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728807296:12345-0@lo:1000: 00100000:10000000:2.0:1784404590.087595:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1784404590.087741:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1784404590.088576:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1784404590.088830:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1784404590.088989:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1784404590.089312:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1784404590.089584:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1784404590.089834:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1784404590.090009:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1784404590.090152:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1784404590.090292:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1784404590.092086:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000001:00080000:1.0:1784404590.092263:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:2.0:1784404590.092476:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1784404590.092618:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1784404590.092775:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1784404590.093161:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1784404590.093746:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1784404590.094204:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000100:00100000:0.0:1784404590.094739:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005baa9fdf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728807296:12345-0@lo:1000: Request processed in 7623us (7957us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784404590.094753:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1784404590.095035:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1784404590.095041:0:7474:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784404590.095056:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728807296:0@lo:1000: 00000100:00100000:1.0:1784404590.095178:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728807424:0@lo:1000: 00000100:00100000:1.0:1784404590.095353:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404590.095431:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b85f2e04 going to sleep for 11 seconds 00100000:10000000:3.0:1784404590.096352:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784404590.096531:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784404590.096705:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784404590.097198:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1784404590.097535:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728807424 00000100:00100000:2.0:1784404590.097545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728807424 00000100:00100000:2.0:1784404590.097598:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784404590.097607:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d18ef9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728807424:12345-0@lo:1000: 00000100:00100000:2.0:1784404590.097740:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d18ef9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1871083728807424:12345-0@lo:1000: Request processed in 133us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404590.097749:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404590.097918:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000065a866ce pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1871083728807424:0@lo:1000: 00000040:00080000:3.0:1784404590.097943:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1784404590.097984:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000e4338660 with version 1 00000040:00080000:3.0:1784404590.100812:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784404590.100934:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784404590.101149:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e4419475 version 1 rpc_version 1 00000020:00100000:2.0:1784404590.101213:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784404590.101223:0:7464:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b9710850 x1871083728807680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404590.101247:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b9710850 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1871083728807680:0@lo:1000: 00000100:00100000:2.0:1784404590.101318:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404590.101364:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ccb6fd4b going to sleep for 11 seconds 00000100:00100000:1.0:1784404590.101447:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728807680 00000100:00100000:1.0:1784404590.101454:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728807680 00000100:00100000:1.0:1784404590.101514:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404590.101523:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094e49923 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1871083728807680:12345-0@lo:1000: 00000001:00080000:3.0:1784404590.105504:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1784404590.105802:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094e49923 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1871083728807680:12345-0@lo:1000: Request processed in 4277us (4481us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784404590.105824:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1784404590.105873:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1784404590.105878:0:7464:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784404590.105896:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b9710850 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1871083728807680:0@lo:1000: 00000001:00080000:0.0:1784404590.111303:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784404590.111355:0:7449:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc2ae01c9b988 00100000:10000000:0.0:1784404590.111363:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1784404590.111963:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784404590.111994:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784404590.112010:0:7449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784404590.112029:0:7449:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:2.0:1784404590.119004:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000004:1.0:1784404590.130586:0:7449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404590.131952:0:7449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1784404590.133259:0:7473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784404590.137080:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784404590.137091:0:7473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1784404590.851025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404591.878697:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404592.900728:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404593.927832:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784404594.099397:0:7718:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784404594.947101:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784404595.040677:0:7770:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404595.041416:0:7770:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784404595.077005:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404595.077046:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ecb93ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728807808:0@lo:41: 00000100:00100000:1.0:1784404595.077150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404595.080466:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d4703e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728808064:0@lo:400: 00000100:00100000:3.0:1784404595.080561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404595.080630:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404595.080636:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ada4f16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728807936:0@lo:400: 00000100:00100000:3.0:1784404595.080670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404595.080728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808064 00000100:00100000:3.0:1784404595.080739:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808064 00000100:00100000:3.0:1784404595.080816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784404595.080827:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaa43b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728808064:12345-0@lo:400: 00000100:00100000:3.0:1784404595.080925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaa43b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728808064:12345-0@lo:400: Request processed in 99us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404595.080932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784404595.080958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728807936 00000100:00100000:3.0:1784404595.080962:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728807936 00000100:00100000:3.0:1784404595.080986:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784404595.080991:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a048de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:3647:x1871083728807936:12345-0@lo:400: 00000100:00100000:3.0:1784404595.081020:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a048de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:3647:x1871083728807936:12345-0@lo:400: Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404595.081026:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784404595.081055:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404595.081064:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e482960c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728808192:0@lo:400: 00000100:00100000:3.0:1784404595.081086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404595.081132:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ada4f16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728807936:0@lo:400: 00010000:00080000:3.0:1784404595.081146:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007d4703e0 x1871083728808064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404595.081158:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d4703e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728808064:0@lo:400: 00000100:00100000:1.0:1784404595.081941:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808192 00000100:00100000:1.0:1784404595.081951:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808192 00000100:00100000:1.0:1784404595.081995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404595.082002:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3b82325 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728808192:12345-0@lo:400: 00000100:00100000:1.0:1784404595.082064:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3b82325 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728808192:12345-0@lo:400: Request processed in 63us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404595.082072:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784404595.082231:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e482960c x1871083728808192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404595.082262:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e482960c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728808192:0@lo:400: 00000100:00100000:3.0:1784404595.083557:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728807808 00000100:00100000:3.0:1784404595.083575:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728807808 00000100:00100000:3.0:1784404595.083650:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404595.083659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a275c527 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728807808:12345-0@lo:41: 00000004:00000024:3.0:1784404595.083711:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1784404595.083816:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a275c527 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728807808:12345-0@lo:41: Request processed in 158us (6666us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404595.083824:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404595.083897:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ecb93ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728807808:0@lo:41: 00010000:00010000:1.0:1784404595.971030:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404596.996230:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784404597.774409:0:7872:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784404597.774624:0:7872:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404598.019387:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784404598.627538:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8cbb3e60 20000000:00000080:1.0:1784404598.627562:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd57c711800 uarg=0000000000000000 20000000:01000000:1.0:1784404598.627626:0:7920:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784404598.627635:0:7920:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784404598.627640:0:7920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784404598.627718:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1784404598.627728:0:7920:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1784404598.630827:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404598.631236:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784404598.631262:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1784404598.631282:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1784404598.631293:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784404598.631309:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.631326:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.631343:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.631350:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.631392:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.631406:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 12 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404598.631419:0:7920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871083728808320:0@lo:104: 00000100:00100000:1.0:1784404598.631477:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404598.631554:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.631559:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 12 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404598.631564:0:7920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f959558f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871083728808448:0@lo:104: 00000100:00100000:1.0:1784404598.631585:0:7920:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9eae0fe going to sleep for 11 seconds 00000100:00100000:0.0:1784404598.632506:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784404598.632534:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404598.632553:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808320 00000100:00100000:0.0:1784404598.632560:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808320 00000100:00100000:0.0:1784404598.632609:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808448 00000100:00100000:0.0:1784404598.632612:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808448 00000100:00100000:0.0:1784404598.632626:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404598.632631:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c16b395b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:7920:x1871083728808320:12345-0@lo:104: 00010000:00010000:0.0:1784404598.632643:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632717:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784404598.632723:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c16b395b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:7920:x1871083728808320:12345-0@lo:104: Request processed in 92us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404598.632730:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404598.632777:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784404598.632783:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bca4c592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:7920:x1871083728808448:12345-0@lo:104: 00010000:00010000:0.0:1784404598.632790:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632823:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784404598.632828:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bca4c592 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:7920:x1871083728808448:12345-0@lo:104: Request processed in 46us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404598.632833:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1784404598.632875:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404598.632880:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632887:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030923c7b already unused, calling callback (00000000930d9091) 10000000:00010000:0.0:1784404598.632890:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632897:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404598.632903:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404598.632909:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784404598.632941:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632947:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404598.632963:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632968:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 0000000030923c7b/0x24b3e2e6dcd78a01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a08 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632979:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404598.632980:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632985:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a0a75a1 already unused, calling callback (00000000930d9091) 10000000:00010000:0.0:1784404598.632987:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.632992:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404598.632998:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404598.633003:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784404598.633010:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633015:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404598.633027:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633041:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: 000000006a0a75a1/0x24b3e2e6dcd78913 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7891a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633053:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404598.633054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404598.633055:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404598.633060:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404598.633076:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bbdf1aa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728808576:0@lo:103: 00000100:00100000:0.0:1784404598.633104:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404598.633142:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000760d0199 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728808704:0@lo:103: 00000100:00100000:0.0:1784404598.633161:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404598.633188:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808576 00000100:00100000:0.0:1784404598.633192:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808576 00010000:00010000:0.0:1784404598.633208:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 13 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404598.633226:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808704 00000100:00100000:0.0:1784404598.633229:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808704 00010000:00010000:0.0:1784404598.633237:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 14 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404598.633248:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404598.633253:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000734e2fb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:3649:x1871083728808576:12345-0@lo:103: 00010000:00010000:0.0:1784404598.633261:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404598.633265:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 14 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633273:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 14 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633293:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404598.633317:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000734e2fb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:3649:x1871083728808576:12345-0@lo:103: Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404598.633324:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404598.633336:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784404598.633341:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a593d027 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:3646:x1871083728808704:12345-0@lo:103: 00010000:00010000:0.0:1784404598.633348:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404598.633352:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 13 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633358:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 13 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633367:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633373:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633383:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633389:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633395:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633400:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633410:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d0b9107 already unused, calling callback (000000000d2bce25) 00010000:00010000:0.0:1784404598.633414:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633420:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633427:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404598.633436:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404598.633459:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a593d027 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:3646:x1871083728808704:12345-0@lo:103: Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404598.633465:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784404598.633498:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000760d0199 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728808704:0@lo:103: 00000100:00100000:0.0:1784404598.633516:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bbdf1aa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728808576:0@lo:103: 00010000:00010000:1.0:1784404598.633817:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e986e92/0x24b3e2e6dcd78a08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a01 expref: 12 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404598.633828:0:7920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871083728808320:0@lo:104: 00010000:00010000:1.0:1784404598.633836:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d81133dc/0x24b3e2e6dcd7891a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78913 expref: 11 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404598.633880:0:7920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f959558f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871083728808448:0@lo:104: 00010000:00010000:1.0:1784404598.633895:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.633903:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.633907:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404598.633912:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008d0b9107/0x24b3e2e6dcd78a39 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.043327:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784404599.199418:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784404599.199427:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd565e88000 from 4 10000000:01000000:1.0:1784404599.199432:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784404599.199485:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd78a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.199500:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd78a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.199510:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd78a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.199536:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f959558f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728808832:0@lo:101: 00000100:00100000:1.0:1784404599.199625:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.199684:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9eae0fe going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.199772:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808832 00000100:00100000:2.0:1784404599.199782:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808832 00000100:00100000:2.0:1784404599.199845:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404599.199890:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee5c4e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:6517:x1871083728808832:12345-0@lo:101: 00010000:00010000:2.0:1784404599.199916:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404599.199932:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c66e0a27/0x24b3e2e6dcd78a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78a40 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.199957:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c66e0a27/0x24b3e2e6dcd78a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.199967:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c66e0a27/0x24b3e2e6dcd78a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.199975:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c66e0a27, rc 0) 00000100:00100000:2.0:1784404599.200022:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee5c4e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6517:x1871083728808832:12345-0@lo:101: Request processed in 135us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.200028:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784404599.200120:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f959558f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728808832:0@lo:101: 00010000:00010000:0.0:1784404599.200136:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd78a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.200144:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd78a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404599.200195:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bbdf1aa8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728808960:0@lo:256: 00000100:00100000:0.0:1784404599.200234:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.200262:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000007c647674 going to sleep for 11 seconds 00000100:00100000:3.0:1784404599.200293:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728808960 00000100:00100000:3.0:1784404599.200300:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728808960 00000100:00100000:3.0:1784404599.200346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784404599.200354:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7308bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6517:x1871083728808960:12345-0@lo:256: 20000000:01000000:3.0:1784404599.200369:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784404599.200388:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784404599.200393:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1784404599.200502:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7308bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6517:x1871083728808960:12345-0@lo:256: Request processed in 149us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404599.200510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784404599.200539:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bbdf1aa8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728808960:0@lo:256: 10000000:01000000:1.0:1784404599.200594:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784404599.200599:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd78a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.200610:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: 00000000d8ecae3b/0x24b3e2e6dcd78a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404599.200620:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784404599.200623:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd565e88000 from 1 10000000:01000000:1.0:1784404599.200625:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404599.200646:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: 000000008d0b9107/0x24b3e2e6dcd78a4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.200651:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: 000000008d0b9107/0x24b3e2e6dcd78a4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.200658:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: 000000008d0b9107/0x24b3e2e6dcd78a4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.200668:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809088:0@lo:101: 00000100:00100000:1.0:1784404599.200691:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.200713:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000005104a818 going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.200797:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809088 00000100:00100000:2.0:1784404599.200801:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809088 00000100:00100000:2.0:1784404599.200832:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784404599.200838:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000183b95f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+12:6517:x1871083728809088:12345-0@lo:101: 00010000:00010000:2.0:1784404599.200845:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404599.200885:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ab32661/0x24b3e2e6dcd78a55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78a4e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.200901:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ab32661/0x24b3e2e6dcd78a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.200908:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ab32661/0x24b3e2e6dcd78a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.200914:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ab32661, rc 0) 00000100:00100000:2.0:1784404599.200946:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000183b95f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:6517:x1871083728809088:12345-0@lo:101: Request processed in 108us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.200951:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784404599.201021:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809088:0@lo:101: 00010000:00010000:1.0:1784404599.201031:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: 000000008d0b9107/0x24b3e2e6dcd78a4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.201038:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: 000000008d0b9107/0x24b3e2e6dcd78a4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.201100:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809216:0@lo:501: 00000100:00100000:1.0:1784404599.201124:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.201150:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000005104a818 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.201219:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809216 00000100:00100000:0.0:1784404599.201224:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809216 00000100:00100000:0.0:1784404599.201256:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784404599.201272:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2d14088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:6517:x1871083728809216:12345-0@lo:501: 00000100:00100000:0.0:1784404599.201400:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2d14088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:6517:x1871083728809216:12345-0@lo:501: Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.201407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784404599.201892:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809216:0@lo:501: 00000100:00100000:1.0:1784404599.201924:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809344:0@lo:503: 00000100:00100000:1.0:1784404599.201968:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.201987:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000005104a818 going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.202106:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809344 00000100:00100000:2.0:1784404599.202110:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809344 00000100:00100000:2.0:1784404599.202143:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784404599.202149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014d2e20a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:6517:x1871083728809344:12345-0@lo:503: 00000100:00100000:2.0:1784404599.202241:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014d2e20a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:6517:x1871083728809344:12345-0@lo:503: Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.202248:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784404599.202322:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809344:0@lo:503: 00000100:00100000:1.0:1784404599.206473:0:7939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7939:1871083728809472:0@lo:502: 00000100:00100000:1.0:1784404599.206565:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.206638:0:7939:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9eae0fe going to sleep for 11 seconds 00000100:00100000:3.0:1784404599.207045:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809472 00000100:00100000:3.0:1784404599.207055:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809472 00000100:00100000:3.0:1784404599.207114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784404599.207124:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4ef670e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7939:x1871083728809472:12345-0@lo:502: 00000100:00100000:3.0:1784404599.207271:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4ef670e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7939:x1871083728809472:12345-0@lo:502: Request processed in 142us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404599.207280:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784404599.210726:0:7939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0673eb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7939:1871083728809472:0@lo:502: 00000020:01000000:1.0:1784404599.210792:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404599.210805:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404599.210808:0:7939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784404599.210814:0:7939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd565e88000 00000020:00000080:1.0:1784404599.210817:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784404599.210927:0:7939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7939:1871083728809600:0@lo:502: 00000100:00100000:2.0:1784404599.211960:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404599.212054:0:7939:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.219218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809600 00000100:00100000:0.0:1784404599.219235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809600 00000100:00100000:3.0:1784404599.219342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784404599.219358:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7939:x1871083728809600:12345-0@lo:502: 00000100:00100000:3.0:1784404599.220562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:7939:x1871083728809600:12345-0@lo:502: Request processed in 1203us (8598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404599.220584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784404599.220652:0:7939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7939:1871083728809600:0@lo:502: 00000020:01000000:1.0:1784404599.220694:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404599.220705:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404599.220708:0:7939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784404599.220714:0:7939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784404599.221897:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784404599.221927:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784404599.221940:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.221955:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404599.221966:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784404599.221969:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd544dfc000 from 21 10000000:01000000:0.0:1784404599.221973:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784404599.222012:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.222021:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.222032:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404599.222056:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809728:0@lo:101: 00000100:00100000:0.0:1784404599.222128:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.222170:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.222245:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809728 00000100:00100000:1.0:1784404599.222258:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809728 00000100:00100000:1.0:1784404599.222301:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784404599.222310:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:6517:x1871083728809728:12345-0@lo:101: 00010000:00010000:1.0:1784404599.222323:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404599.222334:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78a5c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.222359:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.222369:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.222378:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209000, rc 0) 00000100:00100000:1.0:1784404599.222433:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:6517:x1871083728809728:12345-0@lo:101: Request processed in 124us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.222440:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784404599.222527:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809728:0@lo:101: 00010000:00010000:0.0:1784404599.222540:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.222549:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404599.222627:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809856:0@lo:501: 00000100:00100000:0.0:1784404599.222657:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.222690:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.222825:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809856 00000100:00100000:1.0:1784404599.222829:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809856 00000100:00100000:1.0:1784404599.222881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784404599.222889:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:6517:x1871083728809856:12345-0@lo:501: 00000100:00100000:1.0:1784404599.223019:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:6517:x1871083728809856:12345-0@lo:501: Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.223026:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784404599.223099:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809856:0@lo:501: 00000100:00100000:0.0:1784404599.223123:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809984:0@lo:503: 00000100:00100000:0.0:1784404599.223166:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.223194:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.223241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728809984 00000100:00100000:1.0:1784404599.223246:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728809984 00000100:00100000:1.0:1784404599.223273:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784404599.223280:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:6517:x1871083728809984:12345-0@lo:503: 00000100:00100000:1.0:1784404599.223357:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:6517:x1871083728809984:12345-0@lo:503: Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.223369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784404599.223445:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728809984:0@lo:503: 00000100:00100000:0.0:1784404599.224263:0:7940:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7940:1871083728810112:0@lo:502: 00000100:00100000:0.0:1784404599.224306:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.224335:0:7940:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.224412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728810112 00000100:00100000:1.0:1784404599.224419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728810112 00000100:00100000:1.0:1784404599.224455:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784404599.224465:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7940:x1871083728810112:12345-0@lo:502: 00000100:00100000:1.0:1784404599.224557:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7940:x1871083728810112:12345-0@lo:502: Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.224563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784404599.224664:0:7940:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7940:1871083728810112:0@lo:502: 00000100:00100000:0.0:1784404599.224707:0:7940:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7940:1871083728810240:0@lo:502: 00000100:00100000:0.0:1784404599.224754:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.224780:0:7940:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.224917:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728810240 00000100:00100000:1.0:1784404599.224922:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728810240 00000100:00100000:1.0:1784404599.224952:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784404599.224960:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7940:x1871083728810240:12345-0@lo:502: 00000100:00100000:1.0:1784404599.225025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:7940:x1871083728810240:12345-0@lo:502: Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.225031:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784404599.225509:0:7940:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7940:1871083728810240:0@lo:502: 00000040:00080000:0.0:1784404599.225538:0:7940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1784404599.225700:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1784404599.225720:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404599.225728:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.225750:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404599.225758:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784404599.225761:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd544dfc000 from 4 10000000:01000000:1.0:1784404599.225764:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784404599.225787:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.225805:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.225815:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.225829:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810368:0@lo:101: 00000100:00100000:1.0:1784404599.225889:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.225917:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.226080:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728810368 00000100:00100000:2.0:1784404599.226086:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728810368 00000100:00100000:2.0:1784404599.226116:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404599.226123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:6517:x1871083728810368:12345-0@lo:101: 00010000:00010000:2.0:1784404599.226133:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404599.226145:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78a6a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.226166:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.226175:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.226183:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391400, rc 0) 00000100:00100000:2.0:1784404599.226223:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728810368:12345-0@lo:101: Request processed in 100us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.226237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784404599.226410:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810368:0@lo:101: 00010000:00010000:1.0:1784404599.226425:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.226433:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.226477:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810496:0@lo:256: 00000100:00100000:1.0:1784404599.226507:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.226533:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.226583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728810496 00000100:00100000:0.0:1784404599.226587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728810496 00000100:00100000:0.0:1784404599.226620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784404599.226628:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728810496:12345-0@lo:256: 20000000:01000000:0.0:1784404599.226641:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784404599.226657:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784404599.226661:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1784404599.226760:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728810496:12345-0@lo:256: Request processed in 133us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.226767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784404599.226984:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810496:0@lo:256: 10000000:01000000:1.0:1784404599.227027:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784404599.227034:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.227042:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404599.227057:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784404599.227059:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1784404599.227061:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784404599.227078:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.227084:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.227092:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.227102:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810624:0@lo:101: 00000100:00100000:1.0:1784404599.227125:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.227150:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.227190:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728810624 00000100:00100000:0.0:1784404599.227194:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728810624 00000100:00100000:0.0:1784404599.227226:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784404599.227234:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728810624:12345-0@lo:101: 00010000:00010000:0.0:1784404599.227241:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404599.227252:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78a78 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.227265:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.227274:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.227280:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031800, rc 0) 00000100:00100000:0.0:1784404599.227319:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728810624:12345-0@lo:101: Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.227325:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404599.227386:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810624:0@lo:101: 00010000:00010000:2.0:1784404599.227397:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.227403:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404599.227470:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810752:0@lo:501: 00000100:00100000:2.0:1784404599.227497:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404599.227521:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5817a89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.227558:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728810752 00000100:00100000:0.0:1784404599.227563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728810752 00000100:00100000:0.0:1784404599.227601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784404599.227609:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728810752:12345-0@lo:501: 00000100:00100000:0.0:1784404599.227722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728810752:12345-0@lo:501: Request processed in 113us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.227729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404599.227893:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810752:0@lo:501: 00000100:00100000:2.0:1784404599.227920:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810880:0@lo:503: 00000100:00100000:2.0:1784404599.227959:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404599.227980:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728810880 00000100:00100000:2.0:1784404599.227983:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728810880 00000100:00100000:2.0:1784404599.229705:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404599.229721:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728810880:12345-0@lo:503: 00000100:00100000:2.0:1784404599.230118:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728810880:12345-0@lo:503: Request processed in 402us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.230126:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404599.230177:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5817a89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.230203:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728810880:0@lo:503: 00000100:00100000:0.0:1784404599.237911:0:7941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7941:1871083728811008:0@lo:502: 00000100:00100000:0.0:1784404599.238017:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.238061:0:7941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fc540 going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.238223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811008 00000100:00100000:2.0:1784404599.238232:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811008 00000100:00100000:2.0:1784404599.238307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784404599.238317:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:7941:x1871083728811008:12345-0@lo:502: 00000100:00100000:2.0:1784404599.238472:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:7941:x1871083728811008:12345-0@lo:502: Request processed in 157us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.238481:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784404599.238625:0:7941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7941:1871083728811008:0@lo:502: 00000020:01000000:0.0:1784404599.238658:0:7941:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404599.238673:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404599.238676:0:7941:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1784404599.238681:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784404599.238685:0:7941:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:0.0:1784404599.238711:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784404599.238738:0:7941:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dd573a88000) 00000020:00000080:0.0:1784404599.238763:0:7941:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1784404599.238769:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784404599.240121:0:7941:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784404599.240133:0:7941:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784404599.240146:0:7941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd78a8d 00010000:00080000:1.0:1784404599.240183:0:7941:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd573b4f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784404599.245253:0:7941:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1784404599.247827:0:7941:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784404599.247846:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784404599.247920:0:7941:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784404599.247951:0:7941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd78a94 00000100:00080000:3.0:1784404599.247965:0:7941:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784404599.247974:0:7941:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd573b4f800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404599.248022:0:7941:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd565e14700 x1871083728811136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404599.248053:0:7941:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1784404599.248118:0:7941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1784404599.248453:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404599.248474:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728811264:0@lo:400: 00000100:00100000:1.0:1784404599.248589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.248652:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728811392:0@lo:400: 00000100:00100000:1.0:1784404599.248692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.248724:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404599.248729:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728811520:0@lo:400: 00000100:00100000:1.0:1784404599.248767:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.248807:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811264 00000100:00100000:1.0:1784404599.248814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811264 00000100:00100000:1.0:1784404599.248908:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811520 00000100:00100000:1.0:1784404599.248912:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811520 00000100:00100000:1.0:1784404599.248932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404599.248940:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728811264:12345-0@lo:400: 00000100:00100000:1.0:1784404599.248997:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728811264:12345-0@lo:400: Request processed in 57us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.249005:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404599.249021:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404599.249027:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728811520:12345-0@lo:400: 00000100:00100000:1.0:1784404599.249063:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728811520:12345-0@lo:400: Request processed in 36us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.249069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404599.249089:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811392 00000100:00100000:1.0:1784404599.249092:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811392 00000100:00100000:1.0:1784404599.249135:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784404599.249142:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728811392:12345-0@lo:400: 00000100:00100000:1.0:1784404599.249174:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728811392:12345-0@lo:400: Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.249179:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1784404599.249223:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd565e6ed80 x1871083728811520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404599.249237:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728811520:0@lo:400: 00000100:00100000:1.0:1784404599.249249:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728811392:0@lo:400: 00010000:00080000:1.0:1784404599.249746:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd565e6f800 x1871083728811264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404599.249757:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728811264:0@lo:400: 00000100:00100000:0.0:1784404599.249937:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728811136:0@lo:38: 00000100:00100000:0.0:1784404599.249988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784404599.250274:0:7944:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9dd565e71f80 x1871083728811648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404599.250284:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160c6c0 going to sleep for 0 seconds 00000100:00100000:2.0:1784404599.250332:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811136 00000100:00100000:2.0:1784404599.250339:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811136 00000100:00100000:2.0:1784404599.250411:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404599.250419:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083728811136:12345-0@lo:38: 00010000:00080000:2.0:1784404599.250448:0:6525:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1784404599.250486:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd78a9b 00000004:00100000:2.0:1784404599.250505:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784404599.250512:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:3.0:1784404599.250763:0:7941:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404599.250771:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404599.250773:0:7941:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784404599.250776:0:7941:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404599.250780:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404599.250782:0:7941:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784404599.250785:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784404599.250787:0:7941:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784404599.250813:0:7941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7941:1871083728811776:0@lo:502: 00000100:00100000:3.0:1784404599.250904:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404599.250951:0:7941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.252975:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811776 00000100:00100000:2.0:1784404599.252993:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811776 00000100:00100000:2.0:1784404599.253067:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784404599.253081:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:7941:x1871083728811776:12345-0@lo:502: 00000100:00100000:2.0:1784404599.253297:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:7941:x1871083728811776:12345-0@lo:502: Request processed in 219us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.253305:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784404599.254252:0:7941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7941:1871083728811776:0@lo:502: 00000020:01000000:3.0:1784404599.254300:0:7941:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404599.254308:0:7941:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404599.254311:0:7941:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784404599.254315:0:7941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1784404599.256410:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1784404599.256454:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784404599.256466:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.256479:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404599.256502:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784404599.256504:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd544dfc000 from 1 10000000:01000000:2.0:1784404599.256507:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784404599.256541:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.256550:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.256561:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404599.256599:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728811904:0@lo:101: 00000100:00100000:2.0:1784404599.256674:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404599.256715:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd55268ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.257227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811904 00000100:00100000:1.0:1784404599.257235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811904 00000100:00100000:1.0:1784404599.257284:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784404599.257294:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728811904:12345-0@lo:101: 00010000:00010000:1.0:1784404599.257309:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404599.257323:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.257349:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.257361:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.257370:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209600, rc 0) 00000100:00100000:1.0:1784404599.257420:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728811904:12345-0@lo:101: Request processed in 127us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.257427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784404599.257604:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728811904:0@lo:101: 00010000:00010000:1.0:1784404599.257621:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.257632:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.257725:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728812032:0@lo:501: 00000100:00100000:1.0:1784404599.257762:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.257801:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.257818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812032 00000100:00100000:1.0:1784404599.257823:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812032 00000100:00100000:1.0:1784404599.257884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784404599.257895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728812032:12345-0@lo:501: 00000100:00100000:1.0:1784404599.258053:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728812032:12345-0@lo:501: Request processed in 161us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.258062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784404599.258654:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728812032:0@lo:501: 00000100:00100000:1.0:1784404599.258700:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728812160:0@lo:503: 00000100:00100000:1.0:1784404599.258751:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.258778:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.258795:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812160 00000100:00100000:1.0:1784404599.258799:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812160 00000100:00100000:1.0:1784404599.258831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784404599.258875:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728812160:12345-0@lo:503: 00000100:00100000:1.0:1784404599.260241:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728812160:12345-0@lo:503: Request processed in 1397us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.260252:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784404599.260360:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728812160:0@lo:503: 00000100:00080000:0.0:1784404599.260679:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9dd57395b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404599.260790:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083728811136:12345-0@lo:38: Request processed in 10371us (10800us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.260811:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404599.261448:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404599.261460:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784404599.261471:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784404599.261477:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784404599.261532:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1784404599.261554:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d971a545): req@ffff9dd565e71f80 x1871083728811648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404599.261589:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728811136:0@lo:38: 00000100:00100000:2.0:1784404599.261674:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404599.261688:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728812288:0@lo:41: 00000100:00100000:2.0:1784404599.261747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.261812:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812288 00000100:00100000:0.0:1784404599.261818:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812288 00000100:00100000:1.0:1784404599.261898:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.261916:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.262022:0:7946:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7946:1871083728812416:0@lo:502: 00000100:00100000:0.0:1784404599.262047:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728811648 00000100:00100000:0.0:1784404599.262052:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728811648 00000100:00100000:1.0:1784404599.262072:0:7946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.262074:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404599.262083:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1871083728812288:12345-0@lo:41: 00000100:00100000:0.0:1784404599.262101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812416 00000100:00100000:0.0:1784404599.262104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812416 00000100:00100000:1.0:1784404599.262107:0:7946:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601540 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.262130:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784404599.262139:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:7946:x1871083728812416:12345-0@lo:502: 00000100:00100000:0.0:1784404599.262273:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:7946:x1871083728812416:12345-0@lo:502: Request processed in 135us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.262281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000004:00000024:0.0:1784404599.262347:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784404599.262370:0:7946:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7946:1871083728812416:0@lo:502: 00000100:00100000:0.0:1784404599.262396:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1871083728812288:12345-0@lo:41: Request processed in 314us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.262404:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000000:1.0:1784404599.262405:0:7946:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404599.262419:0:7946:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404599.262422:0:7946:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784404599.262433:0:7946:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd544dfc000 00000020:00000080:1.0:1784404599.262436:0:7946:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784404599.262439:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728812288:0@lo:41: 00000100:00100000:1.0:1784404599.262466:0:7946:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7946:1871083728812544:0@lo:502: 00000100:00100000:0.0:1784404599.262466:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784404599.262478:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728811648:12345-0@lo:1000: 00000100:00100000:0.0:1784404599.262540:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728811648:12345-0@lo:1000: Request processed in 65us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.262547:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404599.262587:0:7946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.262588:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728811648:0@lo:1000: 00000100:00100000:1.0:1784404599.262616:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812544 00000100:00100000:1.0:1784404599.262621:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812544 00000040:01000000:0.0:1784404599.262623:0:7944:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784404599.262648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784404599.262656:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:7946:x1871083728812544:12345-0@lo:502: 00000100:00100000:0.0:1784404599.262664:0:7944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728812672:0@lo:1000: 00000100:00100000:0.0:1784404599.262702:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.262718:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.262736:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:7946:x1871083728812544:12345-0@lo:502: Request processed in 80us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.262743:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784404599.262771:0:7946:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601540 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.262783:0:7946:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:7946:1871083728812544:0@lo:502: 00000020:01000000:1.0:1784404599.262798:0:7946:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404599.262802:0:7946:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404599.262804:0:7946:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784404599.262807:0:7946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:2.0:1784404599.262993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812672 00000100:00100000:2.0:1784404599.262998:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812672 00000100:00100000:2.0:1784404599.263030:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784404599.263038:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728812672:12345-0@lo:1000: 00000100:00100000:2.0:1784404599.263133:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728812672:12345-0@lo:1000: Request processed in 96us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.263139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000000:0.0:1784404599.263953:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784404599.263988:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784404599.263998:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.264014:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404599.264026:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784404599.264030:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd545b94d40 from 1 10000000:01000000:0.0:1784404599.264034:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784404599.264081:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.264090:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404599.264100:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404599.264127:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728812800:0@lo:101: 00000100:00100000:0.0:1784404599.264180:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404599.264233:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712900 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.264276:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728812672:0@lo:1000: 00000100:00100000:0.0:1784404599.264330:0:7944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728812928:0@lo:700: 00000100:00100000:2.0:1784404599.264414:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812800 00000100:00100000:2.0:1784404599.264421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812800 00000100:00100000:2.0:1784404599.264453:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784404599.264463:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728812800:12345-0@lo:101: 00010000:00010000:2.0:1784404599.264474:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404599.264626:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ab0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.264651:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.264662:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404599.264672:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391800, rc 0) 00000100:00100000:2.0:1784404599.264718:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728812800:12345-0@lo:101: Request processed in 257us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404599.264725:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784404599.264804:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728812800:0@lo:101: 00010000:00010000:1.0:1784404599.264818:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.264827:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404599.264934:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728813056:0@lo:501: 00000100:00100000:1.0:1784404599.264966:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.264989:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601540 going to sleep for 11 seconds 00000100:00100000:2.0:1784404599.265040:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728813056 00000100:00100000:2.0:1784404599.265046:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728813056 00000100:00100000:2.0:1784404599.265077:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784404599.265091:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728813056:12345-0@lo:501: 00000100:00100000:2.0:1784404599.265182:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728813056:12345-0@lo:501: Request processed in 91us (214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784404599.265190:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784404599.265605:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728813056:0@lo:501: 10000000:01000000:1.0:1784404599.265638:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784404599.265646:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404599.265654:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404599.267016:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.267304:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728812928 00000100:00100000:1.0:1784404599.267313:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728812928 00000100:00100000:1.0:1784404599.267368:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404599.267379:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728812928:12345-0@lo:700: 00000100:00100000:1.0:1784404599.267456:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728812928:12345-0@lo:700: Request processed in 79us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404599.267463:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404599.267497:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5527120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404599.267523:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728812928:0@lo:700: 00000100:00100000:1.0:1784404599.267745:0:7944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728813184:0@lo:1000: 00000100:00100000:1.0:1784404599.267784:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.267811:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd553c53000 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.267874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728813184 00000100:00100000:0.0:1784404599.267880:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728813184 00000100:00100000:0.0:1784404599.267911:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784404599.267922:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728813184:12345-0@lo:1000: 00000100:00100000:0.0:1784404599.267997:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728813184:12345-0@lo:1000: Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.268004:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404599.268036:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728813184:0@lo:1000: 00000004:00080000:1.0:1784404599.268079:0:7944:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9dd570601540 with version 0 00000020:00100000:1.0:1784404599.268100:0:7944:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784404599.268108:0:7944:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dd565e6ed80 x1871083728813440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404599.268121:0:7944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728813440:0@lo:1000: 00000100:00100000:1.0:1784404599.268143:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.268164:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.268817:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728813440 00000100:00100000:0.0:1784404599.268824:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728813440 00000100:00100000:0.0:1784404599.268883:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784404599.268893:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7944:x1871083728813440:12345-0@lo:1000: 00000001:00080000:3.0:1784404599.271253:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1784404599.271278:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784404599.271843:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7944:x1871083728813440:12345-0@lo:1000: Request processed in 2948us (3694us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784404599.271882:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1784404599.272042:0:7944:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1784404599.272048:0:7944:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784404599.272067:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728813440:0@lo:1000: 00000100:00100000:1.0:1784404599.272164:0:7944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728813568:0@lo:1000: 00000100:00100000:1.0:1784404599.272203:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404599.272224:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.272278:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728813568 00000100:00100000:0.0:1784404599.272285:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728813568 00000100:00100000:0.0:1784404599.272331:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784404599.272339:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7944:x1871083728813568:12345-0@lo:1000: 00000100:00100000:0.0:1784404599.272412:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7944:x1871083728813568:12345-0@lo:1000: Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404599.272418:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784404599.272477:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7944:1871083728813568:0@lo:1000: 00000040:00080000:1.0:1784404599.272492:0:7944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1784404599.272519:0:7944:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9dd56ce8e6c0 with version 1 00000004:00080000:3.0:1784404599.274021:0:7942:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9dd551c6f900 version 1 rpc_version 1 00000020:00100000:3.0:1784404599.274054:0:7942:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784404599.274065:0:7942:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9dd565e16300 x1871083728813824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784404599.274086:0:7942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7942:1871083728813824:0@lo:1000: 00000100:00100000:3.0:1784404599.274136:0:7942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404599.274167:0:7942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404599.274231:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728813824 00000100:00100000:0.0:1784404599.274237:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728813824 00000100:00100000:0.0:1784404599.274276:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784404599.274284:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7942:x1871083728813824:12345-0@lo:1000: 00000040:00080000:1.0:1784404599.275568:0:7944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784404599.275665:0:7944:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784404599.275669:0:7944:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1784404599.281407:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1784404599.281777:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7942:x1871083728813824:12345-0@lo:1000: Request processed in 7489us (7635us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784404599.281791:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1784404599.281842:0:7942:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1784404599.281877:0:7942:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784404599.281902:0:7942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7942:1871083728813824:0@lo:1000: 00010000:00010000:0.0:1784404600.067219:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404600.197701:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404600.197731:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728813952:0@lo:41: 00000100:00100000:1.0:1784404600.197801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404600.197893:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728813952 00000100:00100000:1.0:1784404600.197901:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728813952 00000100:00100000:1.0:1784404600.197944:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784404600.197963:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728813952:12345-0@lo:41: 00000004:00000024:1.0:1784404600.198000:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1784404600.198051:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728813952:12345-0@lo:41: Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404600.198058:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784404600.198099:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728813952:0@lo:41: 00010000:00010000:1.0:1784404601.092196:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404602.118686:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404603.140286:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404604.164275:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404604.291082:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728814208:0@lo:400: 00000100:00100000:1.0:1784404604.291396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404604.291453:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784404604.291460:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728814080:0@lo:400: 00000100:00100000:1.0:1784404604.291495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404604.291518:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728814592:0@lo:400: 00000100:00100000:1.0:1784404604.291557:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404604.291590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728814336:0@lo:400: 00000100:00100000:1.0:1784404604.291613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404604.291632:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404604.291638:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728814464:0@lo:400: 00000100:00100000:1.0:1784404604.291672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404604.291708:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814208 00000100:00100000:1.0:1784404604.291715:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814208 00000100:00100000:1.0:1784404604.291767:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814464 00000100:00100000:1.0:1784404604.291770:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814464 00000100:00100000:1.0:1784404604.291789:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784404604.291798:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728814208:12345-0@lo:400: 00000100:00100000:1.0:1784404604.291883:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728814208:12345-0@lo:400: Request processed in 55us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404604.292013:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784404604.292041:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784404604.292047:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728814464:12345-0@lo:400: 00000100:00100000:1.0:1784404604.292149:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728814464:12345-0@lo:400: Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404604.292231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784404604.292252:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814592 00000100:00100000:1.0:1784404604.292256:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814592 00000100:00100000:1.0:1784404604.292346:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814336 00000100:00100000:1.0:1784404604.292350:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814336 00000100:00100000:1.0:1784404604.292365:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784404604.292372:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728814592:12345-0@lo:400: 00000100:00100000:1.0:1784404604.292411:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728814592:12345-0@lo:400: Request processed in 39us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404604.292417:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784404604.292429:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784404604.292436:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728814336:12345-0@lo:400: 00000100:00100000:1.0:1784404604.292464:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728814336:12345-0@lo:400: Request processed in 28us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404604.292470:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784404604.292521:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b99c00 x1871083728814464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404604.292550:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728814464:0@lo:400: 00000100:00100000:1.0:1784404604.292563:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728814336:0@lo:400: 00000100:00100000:1.0:1784404604.292593:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728814592:0@lo:400: 00010000:00080000:1.0:1784404604.292605:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd565e6f800 x1871083728814208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404604.292627:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728814208:0@lo:400: 00000100:00100000:2.0:1784404604.293810:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814080 00000100:00100000:2.0:1784404604.293822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814080 00000100:00100000:2.0:1784404604.293884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784404604.293905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:3649:x1871083728814080:12345-0@lo:400: 00000100:00100000:2.0:1784404604.293968:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:3649:x1871083728814080:12345-0@lo:400: Request processed in 67us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404604.293975:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784404604.294267:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728814080:0@lo:400: 00000100:00100000:1.0:1784404604.307822:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728814720:0@lo:41: 00000100:00100000:1.0:1784404604.308356:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404604.315005:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814720 00000100:00100000:2.0:1784404604.315021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814720 00000100:00100000:3.0:1784404604.315431:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784404604.315444:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728814720:12345-0@lo:41: 00000004:00000024:3.0:1784404604.315484:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1784404604.315593:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728814720:12345-0@lo:41: Request processed in 152us (7238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404604.315601:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784404604.316074:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728814720:0@lo:41: 00010000:00010000:1.0:1784404605.188744:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404605.317220:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728814848:0@lo:41: 00000100:00100000:2.0:1784404605.317305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404605.317737:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814848 00000100:00100000:3.0:1784404605.317746:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814848 00000100:00100000:3.0:1784404605.317816:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784404605.317826:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728814848:12345-0@lo:41: 00000004:00000024:3.0:1784404605.317883:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1784404605.317936:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728814848:12345-0@lo:41: Request processed in 112us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404605.317962:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784404605.318017:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728814848:0@lo:41: 00010000:00010000:0.0:1784404606.214593:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784404606.908777:0:8425:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784404606.908781:0:8425:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784404606.908782:0:8425:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784404606.908939:0:8425:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd574d3a800 00000020:01000004:2.0:1784404606.908954:0:8425:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784404606.908966:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784404606.908979:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dd574c13380) 00000020:00000080:2.0:1784404606.908994:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784404606.952350:0:8425:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784404606.952402:0:8425:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1784404606.973261:0:8425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784404606.973494:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1784404606.973518:0:8425:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784404606.973531:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b3e2e6dcd78ac5 00000020:01000004:0.0:1784404606.973538:0:8425:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784404606.973564:0:8425:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784404606.973569:0:8425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784404606.973575:0:8425:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1784404606.973580:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1784404606.973593:0:8425:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dd573a8cd40) 00000020:00000080:0.0:1784404606.973605:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1784404606.977393:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784404606.977585:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1784404606.977591:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784404606.981314:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1784404606.981326:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784404606.985660:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784404606.985675:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784404606.987622:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784404606.987815:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784404606.987822:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784404606.988616:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784404606.988624:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784404607.018649:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784404607.019004:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784404607.019011:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1784404607.025611:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784404607.025629:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784404607.028207:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784404607.028221:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1784404607.031654:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784404607.032124:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1784404607.032132:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784404607.032677:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784404607.032683:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784404607.070618:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784404607.071047:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784404607.071054:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784404607.072149:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784404607.072163:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784404607.072539:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784404607.072571:0:8425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1784404607.072578:0:8425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1784404607.087945:0:8425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784404607.087984:0:8425:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1784404607.087989:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784404607.087991:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784404607.087992:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784404607.087993:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784404607.087995:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784404607.087996:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784404607.087998:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784404607.088000:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784404607.088001:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784404607.088003:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784404607.088004:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784404607.088008:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1784404607.088010:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784404607.088012:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784404607.088013:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784404607.088014:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784404607.088015:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784404607.088016:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784404607.088017:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784404607.088019:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784404607.088019:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784404607.088020:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784404607.088021:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784404607.088058:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784404607.088078:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728814976:0@lo:253: 00000100:00100000:0.0:1784404607.088156:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.088275:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b4840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.088361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728814976 00000100:00100000:1.0:1784404607.088369:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728814976 00000100:00100000:1.0:1784404607.088458:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784404607.088468:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:8425:x1871083728814976:12345-0@lo:253: 20000000:01000000:1.0:1784404607.088498:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784404607.088512:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1784404607.088517:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1784404607.088521:0:6514:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1784404607.088725:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404607.088880:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1784404607.088895:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1784404607.088917:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1784404607.088923:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1784404607.088935:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1784404607.089611:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1784404607.089742:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1784404607.089761:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:1.0:1784404607.089763:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404607.089780:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1784404607.089786:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404607.089799:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1784404607.089805:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404607.089817:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1784404607.089824:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1784404607.089836:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1784404607.089882:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1784404607.089955:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1784404607.089966:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:1.0:1784404607.089968:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404607.089980:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1784404607.089984:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404607.089994:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1784404607.089998:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404607.090008:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1784404607.090013:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1784404607.090022:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1784404607.090035:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1784404607.090376:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1784404607.090388:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:1.0:1784404607.090390:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404607.090404:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1784404607.090411:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784404607.090425:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1784404607.090430:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404607.090462:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1784404607.090475:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1784404607.090491:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1784404607.090524:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1784404607.090540:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784404607.090543:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784404607.090547:0:6514:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784404607.090592:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784404607.090595:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784404607.091259:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1784404607.091284:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1784404607.091300:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1784404607.091535:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1784404607.091555:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1784404607.091572:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1784404607.091579:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784404607.091581:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784404607.092441:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1784404607.092481:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1784404607.092498:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1784404607.092674:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1784404607.092707:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1784404607.092725:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1784404607.092736:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784404607.092739:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784404607.093125:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1784404607.093148:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1784404607.093181:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1784404607.093305:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1784404607.093326:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1784404607.093341:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1784404607.093350:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784404607.093352:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784404607.093677:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1784404607.093816:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1784404607.093836:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1784404607.093975:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1784404607.093996:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784404607.094016:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094032:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7899f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094040:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094046:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094052:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094059:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094067:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094113:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094126:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.094139:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e73800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815104:0@lo:104: 00000100:00100000:0.0:1784404607.094206:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404607.094302:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094310:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 18 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.094318:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e73100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815232:0@lo:104: 00000100:00100000:0.0:1784404607.094339:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404607.094548:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.094556:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 18 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.094564:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815360:0@lo:104: 00000100:00100000:0.0:1784404607.094599:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.094661:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728815104 00000100:00100000:3.0:1784404607.094669:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728815104 00000100:00100000:3.0:1784404607.094704:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728815232 00000100:00100000:3.0:1784404607.094708:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728815232 00000100:00100000:3.0:1784404607.094723:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404607.094733:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6514:x1871083728815104:12345-0@lo:104: 00010000:00010000:3.0:1784404607.094746:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.094805:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404607.094812:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6514:x1871083728815104:12345-0@lo:104: Request processed in 80us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.094818:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404607.094836:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404607.094842:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6514:x1871083728815232:12345-0@lo:104: 00010000:00010000:3.0:1784404607.094873:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.094920:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784404607.094925:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6514:x1871083728815232:12345-0@lo:104: Request processed in 84us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.094931:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1784404607.094948:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784404607.094954:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.094961:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540030800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404607.094966:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.094974:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404607.094981:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404607.094987:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404607.095016:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095023:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404607.095040:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095046:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd78ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ab7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095069:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404607.095072:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095078:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404607.095081:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095087:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404607.095093:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404607.095098:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404607.095111:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095116:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404607.095132:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095139:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78a78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a7f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095150:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404607.095152:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404607.095154:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404607.095165:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728815488:0@lo:103: 00000100:00100000:3.0:1784404607.095197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.095235:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728815616:0@lo:103: 00000100:00100000:3.0:1784404607.095257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.095295:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728815488 00000100:00100000:3.0:1784404607.095299:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728815488 00010000:00010000:3.0:1784404607.095328:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 19 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404607.095349:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728815616 00000100:00100000:3.0:1784404607.095352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728815616 00010000:00010000:3.0:1784404607.095363:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 20 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404607.095377:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404607.095383:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:3647:x1871083728815488:12345-0@lo:103: 00010000:00010000:3.0:1784404607.095395:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404607.095399:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 20 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095409:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 20 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095424:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404607.095455:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:3647:x1871083728815488:12345-0@lo:103: Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.095461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404607.095474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404607.095479:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3648:x1871083728815616:12345-0@lo:103: 00010000:00010000:3.0:1784404607.095498:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404607.095521:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 19 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095530:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 19 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.095540:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404607.095570:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3648:x1871083728815616:12345-0@lo:103: Request processed in 90us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.095577:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404607.095614:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728815616:0@lo:103: 00000100:00100000:3.0:1784404607.095640:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728815488:0@lo:103: 00010000:00010000:2.0:1784404607.095711:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404607.095812:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.095822:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.095840:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815744:0@lo:104: 00000100:00100000:0.0:1784404607.095920:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404607.095945:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7899f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.095953:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7899f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 18 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.095962:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815872:0@lo:104: 00000100:00100000:0.0:1784404607.095982:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.095992:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77600 going to sleep for 11 seconds 00010000:00010000:0.0:1784404607.096004:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ab0 expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.096015:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e73800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815104:0@lo:104: 00010000:00010000:0.0:1784404607.096024:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a78 expref: 17 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.096033:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e73100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815232:0@lo:104: 00000100:00100000:3.0:1784404607.096089:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728815360 00000100:00100000:3.0:1784404607.096093:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728815360 00000100:00100000:3.0:1784404607.096111:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728815744 00000100:00100000:3.0:1784404607.096114:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728815744 00000100:00100000:3.0:1784404607.096124:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728815872 00000100:00100000:3.0:1784404607.096127:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728815872 00000100:00100000:3.0:1784404607.096139:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784404607.096145:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:6514:x1871083728815360:12345-0@lo:104: 00010000:00010000:3.0:1784404607.096153:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.096231:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404607.096238:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:6514:x1871083728815360:12345-0@lo:104: Request processed in 93us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.096244:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784404607.096259:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404607.096265:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6514:x1871083728815744:12345-0@lo:104: 00010000:00010000:3.0:1784404607.096278:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.096345:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815360:0@lo:104: 00000100:00100000:0.0:1784404607.096353:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815744:0@lo:104: 00010000:00010000:2.0:1784404607.096445:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404607.096451:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096458:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404607.096461:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096468:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404607.096476:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404607.096482:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404607.096523:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096530:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404607.096556:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096562:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096572:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404607.096575:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096589:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404607.096592:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096598:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404607.096603:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404607.096608:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404607.096620:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096625:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404607.096637:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096642:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208200/0x24b3e2e6dcd78a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a16 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096653:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404607.096654:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404607.096656:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404607.096735:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728816000:0@lo:103: 00000100:00100000:0.0:1784404607.096762:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.096823:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816000 00000100:00100000:2.0:1784404607.096827:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816000 00010000:00010000:2.0:1784404607.096845:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 17 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404607.096890:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784404607.096903:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:3649:x1871083728816000:12345-0@lo:103: 00010000:00010000:2.0:1784404607.096912:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404607.096917:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 17 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096926:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 17 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096938:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a5c expref: 17 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.096950:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404607.096988:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:3649:x1871083728816000:12345-0@lo:103: Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.096995:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784404607.097103:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728816000:0@lo:103: 00010000:00010000:2.0:1784404607.100843:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404607.100952:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1784404607.100968:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6514:x1871083728815744:12345-0@lo:104: Request processed in 4697us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.100979:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404607.101020:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404607.101035:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6514:x1871083728815872:12345-0@lo:104: 00010000:00010000:3.0:1784404607.101053:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.101202:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404607.101207:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6514:x1871083728815872:12345-0@lo:104: Request processed in 181us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.101214:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404607.101248:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728816128:0@lo:103: 00000100:00100000:3.0:1784404607.101284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.101330:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816128 00000100:00100000:3.0:1784404607.101337:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816128 00010000:00010000:3.0:1784404607.101360:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404607.101389:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404607.101396:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:3646:x1871083728816128:12345-0@lo:103: 00010000:00010000:3.0:1784404607.101405:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404607.101411:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.101435:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.101450:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a0f expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.101463:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404607.101489:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3646:x1871083728816128:12345-0@lo:103: Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.101495:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404607.101545:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728816128:0@lo:103: 00010000:00010000:2.0:1784404607.101611:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404607.101618:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.101626:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404607.101630:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.101639:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404607.101648:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404607.101665:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404607.101708:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.101715:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404607.101727:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.101735:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208c00/0x24b3e2e6dcd78998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7899f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.101750:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404607.101752:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404607.101754:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404607.101791:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404607.101800:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728816256:0@lo:103: 00000100:00100000:3.0:1784404607.101828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.101887:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816256 00000100:00100000:3.0:1784404607.101891:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816256 00010000:00010000:3.0:1784404607.101906:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7899f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 15 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404607.101929:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404607.101936:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3646:x1871083728816256:12345-0@lo:103: 00010000:00010000:3.0:1784404607.101943:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404607.101947:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7899f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 15 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.101956:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7899f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 15 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.101979:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.101988:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102001:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102008:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102015:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102020:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102026:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404607.102029:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102036:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102044:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.102052:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404607.102081:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3646:x1871083728816256:12345-0@lo:103: Request processed in 146us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.102096:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404607.102142:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728816256:0@lo:103: 00010000:00010000:0.0:1784404607.102254:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7899f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78998 expref: 14 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.102276:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1871083728815872:0@lo:104: 00010000:00010000:0.0:1784404607.102301:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.102309:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.102315:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.102320:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031000/0x24b3e2e6dcd78ad3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784404607.102334:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784404607.104264:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:8425:x1871083728814976:12345-0@lo:253: Request processed in 15790us (16100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.104277:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784404607.104425:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728814976:0@lo:253: 10000000:01000000:1.0:1784404607.104441:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784404607.104445:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784404607.104447:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784404607.104448:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404607.104450:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1784404607.104451:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404607.104453:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404607.104454:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404607.104456:0:8425:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784404607.104458:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404607.104459:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784404607.104482:0:8425:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd574d3a800 from lustre-OST0000 10000000:01000000:1.0:1784404607.104522:0:8425:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784404607.104525:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784404607.104532:0:8425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd545b94d40 local copy 10000000:01000000:1.0:1784404607.104537:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784404607.104572:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.104597:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.104606:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.104625:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816384:0@lo:101: 00000100:00100000:1.0:1784404607.104660:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.104698:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028540 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.104754:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816384 00000100:00100000:2.0:1784404607.104761:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816384 00000100:00100000:2.0:1784404607.104805:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784404607.104814:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+13:8425:x1871083728816384:12345-0@lo:101: 00010000:00010000:2.0:1784404607.104837:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404607.104871:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ada expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.104892:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ada expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.104902:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ada expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.104910:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541390600, rc 0) 00000100:00100000:2.0:1784404607.104959:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728816384:12345-0@lo:101: Request processed in 147us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.104966:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784404607.105410:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816384:0@lo:101: 00010000:00010000:1.0:1784404607.105423:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.105432:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.105526:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816512:0@lo:501: 00000100:00100000:1.0:1784404607.105553:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.105579:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028540 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.105626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816512 00000100:00100000:0.0:1784404607.105631:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816512 00000100:00100000:0.0:1784404607.105665:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784404607.105672:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728816512:12345-0@lo:501: 00000100:00100000:0.0:1784404607.105738:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728816512:12345-0@lo:501: Request processed in 66us (184us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784404607.105744:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784404607.105812:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816512:0@lo:501: 10000000:01000000:1.0:1784404607.105825:0:8425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784404607.105842:0:8425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784404607.105876:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.105885:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.105899:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.105920:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784404607.105943:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd574d3a800 10000000:01000000:1.0:1784404607.105947:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784404607.105953:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784404607.105956:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784404607.105960:0:8425:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784404607.105963:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784404607.105980:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.105987:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.105994:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.106005:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816640:0@lo:101: 00000100:00100000:1.0:1784404607.106027:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.106038:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.106107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816640 00000100:00100000:0.0:1784404607.106111:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816640 00000100:00100000:0.0:1784404607.106133:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784404607.106139:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728816640:12345-0@lo:101: 00010000:00010000:0.0:1784404607.106154:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404607.106165:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ae8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106181:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106199:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106206:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031600, rc 0) 00000100:00100000:0.0:1784404607.106233:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728816640:12345-0@lo:101: Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.106238:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:0.0:1784404607.106260:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404607.106265:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106272:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404607.106275:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106282:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404607.106289:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404607.106295:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404607.106311:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106323:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404607.106345:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106351:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78ada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78ae1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106365:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404607.106367:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404607.106368:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404607.106457:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404607.106468:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728816768:0@lo:103: 00000100:00100000:1.0:1784404607.106496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.106555:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816640:0@lo:101: 00010000:00010000:1.0:1784404607.106564:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.106578:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.106631:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816896:0@lo:501: 00000100:00100000:1.0:1784404607.106655:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.106666:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.106715:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816896 00000100:00100000:0.0:1784404607.106720:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816896 00000100:00100000:0.0:1784404607.106748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784404607.106755:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728816896:12345-0@lo:501: 00000100:00100000:0.0:1784404607.106842:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728816896:12345-0@lo:501: Request processed in 87us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.106870:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784404607.106893:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728816768 00000100:00100000:0.0:1784404607.106896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728816768 00000100:00100000:0.0:1784404607.106921:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784404607.106927:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3649:x1871083728816768:12345-0@lo:103: 00010000:00010000:0.0:1784404607.106935:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404607.106947:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ada expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.106956:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404607.106981:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:3649:x1871083728816768:12345-0@lo:103: Request processed in 54us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.106996:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404607.107058:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728816768:0@lo:103: 00000100:00100000:1.0:1784404607.107085:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728816896:0@lo:501: 00000100:00100000:1.0:1784404607.107125:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817024:0@lo:503: 00000100:00100000:1.0:1784404607.107162:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.107198:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.107300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817024 00000100:00100000:0.0:1784404607.107304:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817024 00000100:00100000:0.0:1784404607.107334:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784404607.107341:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728817024:12345-0@lo:503: 00000100:00100000:0.0:1784404607.107421:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728817024:12345-0@lo:503: Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.107428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784404607.107615:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817024:0@lo:503: 00000040:00080000:1.0:1784404607.107888:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784404607.107963:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817152:0@lo:502: 00000100:00100000:1.0:1784404607.108001:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.108019:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.108088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817152 00000100:00100000:0.0:1784404607.108093:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817152 00000100:00100000:0.0:1784404607.108118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784404607.108124:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728817152:12345-0@lo:502: 00000100:00100000:0.0:1784404607.108203:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728817152:12345-0@lo:502: Request processed in 67us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.108211:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784404607.108338:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817152:0@lo:502: 00000040:00080000:1.0:1784404607.108523:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784404607.108550:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784404607.108562:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784404607.108573:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784404607.108584:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784404607.108597:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784404607.108616:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817280:0@lo:502: 00000100:00100000:1.0:1784404607.108657:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.108689:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028780 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.108758:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817280 00000100:00100000:2.0:1784404607.108763:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817280 00000100:00100000:2.0:1784404607.108798:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784404607.108806:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728817280:12345-0@lo:502: 00000100:00100000:2.0:1784404607.108902:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728817280:12345-0@lo:502: Request processed in 97us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.108909:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784404607.108992:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817280:0@lo:502: 00000040:00080000:1.0:1784404607.109030:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784404607.109037:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784404607.110535:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784404607.110545:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784404607.110553:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404607.110555:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784404607.110561:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784404607.110577:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dd570464d40) 00000020:00000080:3.0:1784404607.110602:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784404607.110607:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784404607.110669:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd574d3a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784404607.110679:0:8448:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784404607.110686:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b3e2e6dcd78afd 00010000:00010000:3.0:1784404607.117727:0:8448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1784404607.118330:0:8448:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784404607.120825:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784404607.121446:0:8448:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784404607.127537:0:8448:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1784404607.127792:0:8448:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1784404607.133361:0:8448:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1784404607.134657:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784404607.134668:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404607.134674:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.134676:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784404607.134680:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404607.134683:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.134685:0:8448:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784404607.134687:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784404607.134689:0:8448:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784404607.134711:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404607.134714:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.134716:0:8448:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784404607.134719:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784404607.134882:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1784404607.134911:0:8425:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784404607.134932:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.134944:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404607.134952:0:8425:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd574d3a800 from 1 10000000:01000000:1.0:1784404607.134955:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404607.134991:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.134999:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.135009:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.135031:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817408:0@lo:101: 00000100:00100000:1.0:1784404607.135096:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.135134:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817408 00000100:00100000:1.0:1784404607.135140:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817408 00000100:00100000:1.0:1784404607.135336:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784404607.135346:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:8425:x1871083728817408:12345-0@lo:101: 00010000:00010000:1.0:1784404607.135369:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404607.135381:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78b04 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.135404:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.135415:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.135424:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d208c00, rc 0) 00000100:00100000:1.0:1784404607.135458:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817408:12345-0@lo:101: Request processed in 113us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.135465:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784404607.136028:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.136056:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817408:0@lo:101: 00010000:00010000:0.0:1784404607.136072:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.136081:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.136172:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817536:0@lo:501: 00000100:00100000:0.0:1784404607.136271:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.136302:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.136368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817536 00000100:00100000:2.0:1784404607.136373:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817536 00000100:00100000:2.0:1784404607.136407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784404607.136415:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817536:12345-0@lo:501: 00000100:00100000:2.0:1784404607.136525:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817536:12345-0@lo:501: Request processed in 111us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.136532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784404607.136578:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817536:0@lo:501: 00000100:00100000:2.0:1784404607.136605:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817664:0@lo:503: 00000100:00100000:2.0:1784404607.136642:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.136663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817664 00000100:00100000:2.0:1784404607.136666:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817664 00000100:00100000:2.0:1784404607.136682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784404607.136688:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817664:12345-0@lo:503: 00000100:00100000:2.0:1784404607.136757:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817664:12345-0@lo:503: Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.136763:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784404607.136796:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.136808:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817664:0@lo:503: 00000040:00080000:2.0:1784404607.137062:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784404607.137119:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817792:0@lo:502: 00000100:00100000:2.0:1784404607.137153:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.137175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817792 00000100:00100000:2.0:1784404607.137178:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817792 00000100:00100000:2.0:1784404607.137261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784404607.137268:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817792:12345-0@lo:502: 00000100:00100000:2.0:1784404607.137329:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817792:12345-0@lo:502: Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.137335:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784404607.137369:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.137382:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817792:0@lo:502: 00000040:00080000:2.0:1784404607.137596:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784404607.137623:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784404607.137649:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817920:0@lo:502: 00000100:00100000:2.0:1784404607.137682:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.137704:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728817920 00000100:00100000:2.0:1784404607.137708:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728817920 00000100:00100000:2.0:1784404607.137726:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784404607.137732:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817920:12345-0@lo:502: 00000100:00100000:2.0:1784404607.137793:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728817920:12345-0@lo:502: Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.137799:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784404607.137827:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.137839:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728817920:0@lo:502: 00000040:00080000:2.0:1784404607.137904:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784404607.137910:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784404607.140356:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404607.140368:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.140370:0:8451:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784404607.140377:0:8451:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd574d3a800 00000020:00000080:2.0:1784404607.140379:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784404607.140391:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404607.140394:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.140395:0:8451:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784404607.140398:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784404607.141019:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784404607.141051:0:8425:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784404607.141077:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.141089:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404607.141136:0:8425:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784404607.141139:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd574d3a800 10000000:01000000:0.0:1784404607.141143:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd574d3a800 10000000:01000000:0.0:1784404607.141147:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784404607.141153:0:8425:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd574d3a800 from 1 10000000:01000000:0.0:1784404607.141156:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784404607.141203:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.141212:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.141222:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.141245:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818048:0@lo:101: 00000100:00100000:0.0:1784404607.141305:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.142309:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77300 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.142464:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818048 00000100:00100000:2.0:1784404607.142472:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818048 00000100:00100000:2.0:1784404607.142568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784404607.142577:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8425:x1871083728818048:12345-0@lo:101: 00010000:00010000:2.0:1784404607.142591:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404607.142606:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78b12 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.142644:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.142654:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.142662:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541390600, rc 0) 00000100:00100000:2.0:1784404607.142706:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818048:12345-0@lo:101: Request processed in 131us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.142713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784404607.142772:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818048:0@lo:101: 00010000:00010000:0.0:1784404607.142788:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.142808:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.142933:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818176:0@lo:501: 00000100:00100000:0.0:1784404607.142962:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.143112:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.143275:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818176 00000100:00100000:1.0:1784404607.143281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818176 00000100:00100000:1.0:1784404607.143307:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784404607.143315:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818176:12345-0@lo:501: 00000100:00100000:1.0:1784404607.143427:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818176:12345-0@lo:501: Request processed in 113us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.143435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784404607.143529:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818176:0@lo:501: 00000100:00100000:0.0:1784404607.143559:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818304:0@lo:503: 00000100:00100000:0.0:1784404607.143603:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.143626:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.143679:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818304 00000100:00100000:1.0:1784404607.143683:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818304 00000100:00100000:1.0:1784404607.143698:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784404607.143703:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818304:12345-0@lo:503: 00000100:00100000:1.0:1784404607.143785:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818304:12345-0@lo:503: Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.143792:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784404607.143881:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818304:0@lo:503: 00000040:00080000:0.0:1784404607.144104:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784404607.144167:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818432:0@lo:502: 00000100:00100000:0.0:1784404607.144214:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.144241:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.144348:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818432 00000100:00100000:1.0:1784404607.144352:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818432 00000100:00100000:1.0:1784404607.144372:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784404607.144378:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818432:12345-0@lo:502: 00000100:00100000:1.0:1784404607.144460:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818432:12345-0@lo:502: Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.144467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784404607.144561:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818432:0@lo:502: 00000040:00080000:0.0:1784404607.144747:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784404607.144773:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784404607.144788:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784404607.144801:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784404607.144811:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784404607.144822:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784404607.144847:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784404607.145017:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784404607.145031:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784404607.145044:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784404607.145069:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784404607.145083:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784404607.145096:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784404607.145108:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784404607.145121:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784404607.145133:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784404607.145145:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784404607.145157:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784404607.145169:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784404607.145182:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784404607.145273:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784404607.145289:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784404607.145313:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784404607.145329:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784404607.145342:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1784404607.145354:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1784404607.145367:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1784404607.145382:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1784404607.145395:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1784404607.145410:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1784404607.145422:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1784404607.145435:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1784404607.145449:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1784404607.145462:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1784404607.145475:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1784404607.145488:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1784404607.145510:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1784404607.145542:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818560:0@lo:502: 00000100:00100000:0.0:1784404607.145592:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.145612:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77300 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.145743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818560 00000100:00100000:2.0:1784404607.145749:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818560 00000100:00100000:2.0:1784404607.145782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784404607.145790:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818560:12345-0@lo:502: 00000100:00100000:2.0:1784404607.145900:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728818560:12345-0@lo:502: Request processed in 111us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.145907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784404607.147292:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728818560:0@lo:502: 00000040:00080000:2.0:1784404607.147374:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1784404607.147387:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784404607.150842:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784404607.150967:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dd44213cd40) 00000020:00000080:1.0:1784404607.150991:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1784404607.151259:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd574d3a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784404607.151264:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd574d3a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784404607.151267:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd574d3a800 3 00010000:00080000:1.0:1784404607.151296:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd573b4b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784404607.158721:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1784404607.158848:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784404607.158906:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784404607.158922:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x24b3e2e6dcd78b27 00000100:00080000:1.0:1784404607.158933:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784404607.158938:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd573b4b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404607.158976:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b98a80 x1871083728818688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404607.159015:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728818688:0@lo:38: 00000100:00100000:1.0:1784404607.159088:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.159149:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818688 00000100:00100000:1.0:1784404607.159155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818688 00000100:00100000:1.0:1784404607.159182:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404607.159439:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1871083728818688:12345-0@lo:38: 00010000:00080000:1.0:1784404607.159469:0:6520:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:1.0:1784404607.159530:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x24b3e2e6dcd78b2e 00000004:00100000:1.0:1784404607.159546:0:6520:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784404607.159585:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9dd442284000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404607.159648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1871083728818688:12345-0@lo:38: Request processed in 457us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.159655:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1784404607.159676:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784404607.159753:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728818816:0@lo:400: 00000100:00100000:1.0:1784404607.159778:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.159798:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404607.159804:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728819200:0@lo:400: 00000100:00100000:1.0:1784404607.159828:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.159884:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728818944:0@lo:400: 00000100:00100000:1.0:1784404607.159909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.159927:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404607.159932:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728819072:0@lo:400: 00000100:00100000:1.0:1784404607.159952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.159980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818816 00000100:00100000:1.0:1784404607.159984:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818816 00000100:00100000:1.0:1784404607.160009:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819072 00000100:00100000:1.0:1784404607.160012:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819072 00000100:00100000:1.0:1784404607.160025:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784404607.160031:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728818816:12345-0@lo:400: 00000100:00100000:1.0:1784404607.160069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728818816:12345-0@lo:400: Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.160076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784404607.160096:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784404607.160102:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728819072:12345-0@lo:400: 00000100:00100000:1.0:1784404607.160136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728819072:12345-0@lo:400: Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.160142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784404607.160162:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819200 00000100:00100000:1.0:1784404607.160165:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819200 00000100:00100000:1.0:1784404607.160181:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728818944 00000100:00100000:1.0:1784404607.160184:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728818944 00000100:00100000:0.0:1784404607.160905:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784404607.160917:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728819200:12345-0@lo:400: 00000100:00100000:0.0:1784404607.160970:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728819200:12345-0@lo:400: Request processed in 56us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.160977:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1784404607.161090:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b98a80 x1871083728818688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404607.161101:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404607.161110:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1784404607.161116:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784404607.161120:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784404607.161129:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784404607.161135:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728818688:0@lo:38: 00000100:00100000:1.0:1784404607.162566:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784404607.162583:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728818944:12345-0@lo:400: 00000100:00100000:1.0:1784404607.162660:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728818944:12345-0@lo:400: Request processed in 84us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.162667:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:01000004:2.0:1784404607.163430:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784404607.163446:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dd574c10000) 00000020:00000080:2.0:1784404607.163468:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1784404607.165202:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd574d3a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784404607.165210:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd574d3a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784404607.165213:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd574d3a800 3 00010000:00080000:2.0:1784404607.165249:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd57df4b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404607.169470:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1784404607.169591:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1784404607.169634:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784404607.169647:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x24b3e2e6dcd78b3c 00000100:00080000:2.0:1784404607.169658:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404607.169665:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dd57df4b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404607.169700:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570590700 x1871083728819328/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404607.169739:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083728819328:0@lo:38: 00000100:00100000:2.0:1784404607.169812:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784404607.169938:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784404607.170991:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728819200:0@lo:400: 00010000:00080000:1.0:1784404607.171011:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b9b800 x1871083728818816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.171022:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728818816:0@lo:400: 00010000:00080000:1.0:1784404607.171061:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b9ad80 x1871083728819072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.171070:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728819072:0@lo:400: 00000100:00100000:1.0:1784404607.171080:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728818944:0@lo:400: 00000040:00080000:2.0:1784404607.171628:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1784404607.171685:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1784404607.171716:0:8425:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784404607.171732:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.171744:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784404607.171829:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784404607.171831:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784404607.171833:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404607.171834:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404607.171835:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404607.171836:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404607.171838:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784404607.171839:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784404607.171840:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784404607.171842:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404607.171843:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404607.171847:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1784404607.171876:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784404607.171877:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784404607.171878:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404607.171879:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404607.171880:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404607.171882:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404607.171883:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784404607.171884:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784404607.171885:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784404607.171886:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404607.171887:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404607.171913:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784404607.171929:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728819456:0@lo:253: 00000100:00100000:2.0:1784404607.171999:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.172037:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819456 00000100:00100000:2.0:1784404607.172044:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819456 00000100:00100000:2.0:1784404607.172085:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784404607.172094:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728819456:12345-0@lo:253: 20000000:01000000:2.0:1784404607.172122:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784404607.172135:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784404607.173660:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762000 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.174336:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819328 00000100:00100000:0.0:1784404607.174345:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819328 00000100:00100000:0.0:1784404607.174785:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784404607.174794:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083728819328:12345-0@lo:38: 00010000:00080000:0.0:1784404607.174824:0:6521:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1784404607.174884:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x24b3e2e6dcd78b43 00000004:00100000:0.0:1784404607.174902:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784404607.174932:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404607.175017:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1871083728819328:12345-0@lo:38: Request processed in 222us (5205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.175025:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784404607.175111:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd570590700 x1871083728819328/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404607.175128:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404607.175136:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1784404607.175143:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784404607.175147:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784404607.175149:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57df4b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784404607.175155:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083728819328:0@lo:38: 20000000:01000000:2.0:1784404607.177707:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784404607.177758:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784404607.178076:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:8425:x1871083728819456:12345-0@lo:253: Request processed in 5978us (6072us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.178088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784404607.178245:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8425:1871083728819456:0@lo:253: 10000000:01000000:1.0:1784404607.178258:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784404607.178261:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784404607.178270:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784404607.178271:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404607.178273:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404607.178274:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404607.178275:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404607.178277:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404607.178278:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784404607.178279:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784404607.178280:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404607.178282:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784404607.178298:0:8425:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1784404607.182050:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784404607.182059:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784404607.182080:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.182098:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.182106:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.182112:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.182151:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.182178:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 15 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.182253:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728819584:0@lo:104: 00000100:00100000:0.0:1784404607.182319:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404607.182413:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.182422:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 15 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.182430:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728819712:0@lo:104: 00000100:00100000:0.0:1784404607.182449:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.184078:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784404607.184114:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.184185:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819584 00000100:00100000:2.0:1784404607.184202:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819584 00000100:00100000:3.0:1784404607.184257:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819712 00000100:00100000:3.0:1784404607.184261:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819712 00000100:00100000:3.0:1784404607.184285:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404607.184295:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c706c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6535:x1871083728819584:12345-0@lo:104: 00010000:00010000:3.0:1784404607.184309:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184385:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404607.184391:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c706c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6535:x1871083728819584:12345-0@lo:104: Request processed in 98us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.184408:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404607.184445:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404607.184452:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728819712:12345-0@lo:104: 00010000:00010000:3.0:1784404607.184460:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184493:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784404607.184498:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728819712:12345-0@lo:104: Request processed in 48us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.184516:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1784404607.184535:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784404607.184541:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184548:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404607.184552:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184561:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404607.184568:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404607.184573:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404607.184608:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184614:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404607.184638:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184645:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a71 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184658:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404607.184662:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184668:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404607.184670:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184676:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404607.184682:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404607.184687:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404607.184700:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184704:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404607.184714:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184721:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.184736:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404607.184743:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404607.184745:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404607.184881:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728819840:0@lo:103: 00000100:00100000:1.0:1784404607.184920:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.184971:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728819968:0@lo:103: 00000100:00100000:1.0:1784404607.184993:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.185024:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819840 00000100:00100000:1.0:1784404607.185027:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819840 00010000:00010000:1.0:1784404607.185046:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 16 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.185066:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728819968 00000100:00100000:1.0:1784404607.185069:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728819968 00010000:00010000:1.0:1784404607.185080:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 17 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.185093:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404607.185099:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:3649:x1871083728819840:12345-0@lo:103: 00010000:00010000:1.0:1784404607.185110:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404607.185115:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 17 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185123:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 17 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185145:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404607.185171:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:3649:x1871083728819840:12345-0@lo:103: Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.185178:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404607.185204:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404607.185211:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:3646:x1871083728819968:12345-0@lo:103: 00010000:00010000:1.0:1784404607.185219:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404607.185223:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 16 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185231:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 16 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185242:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185249:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784404607.185262:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008450886s 00010000:00010000:1.0:1784404607.185267:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185273:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185280:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185286:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185297:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404607.185301:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185308:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185317:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185326:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404607.185357:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:3646:x1871083728819968:12345-0@lo:103: Request processed in 147us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.185363:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404607.185396:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728819968:0@lo:103: 00000100:00100000:1.0:1784404607.185419:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728819840:0@lo:103: 00010000:00010000:1.0:1784404607.185438:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a6a expref: 15 pid: 6514 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.185449:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728819584:0@lo:104: 00010000:00010000:1.0:1784404607.185457:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a40 expref: 14 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.185465:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728819712:0@lo:104: 00010000:00010000:1.0:1784404607.185478:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185496:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185513:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.185518:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1784404607.186136:0:8425:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1784404607.186475:0:8425:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784404607.186699:0:8425:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1784404607.187327:0:8425:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784404607.187593:0:8425:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784404607.187801:0:8425:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1784404607.188079:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784404607.189105:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784404607.199701:0:8425:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784404607.199710:0:8425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784404607.199744:0:8425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784404607.199781:0:8425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784404607.199803:0:8425:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784404607.199821:0:8425:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1784404607.200707:0:8425:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404607.200892:0:8425:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1784404607.244994:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784404607.539142:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784404607.539151:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd565e88000 from 30 10000000:01000000:2.0:1784404607.539157:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784404607.539219:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.539230:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.539240:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404607.539282:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820096:0@lo:101: 00000100:00100000:2.0:1784404607.539356:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.539425:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed600 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.539659:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820096 00000100:00100000:0.0:1784404607.539668:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820096 00000100:00100000:0.0:1784404607.539734:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784404607.539744:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:6517:x1871083728820096:12345-0@lo:101: 00010000:00010000:0.0:1784404607.539757:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404607.539769:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78b51 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.539794:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.539805:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.539813:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031800, rc 0) 00000100:00100000:0.0:1784404607.539944:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728820096:12345-0@lo:101: Request processed in 201us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.539951:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784404607.544354:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820096:0@lo:101: 00010000:00010000:2.0:1784404607.544386:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.544399:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404607.544510:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820224:0@lo:501: 00000100:00100000:2.0:1784404607.544566:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.544601:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed600 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.544689:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820224 00000100:00100000:0.0:1784404607.544695:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820224 00000100:00100000:0.0:1784404607.544779:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784404607.544788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728820224:12345-0@lo:501: 00000100:00100000:0.0:1784404607.544945:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728820224:12345-0@lo:501: Request processed in 156us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.544953:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784404607.545019:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820224:0@lo:501: 00000100:00100000:2.0:1784404607.545044:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820352:0@lo:503: 00000100:00100000:2.0:1784404607.545084:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.559401:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.564514:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820352 00000100:00100000:1.0:1784404607.564531:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820352 00000100:00100000:1.0:1784404607.564597:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784404607.564609:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728820352:12345-0@lo:503: 00000100:00100000:1.0:1784404607.564797:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728820352:12345-0@lo:503: Request processed in 189us (19711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.564806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784404607.565314:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820352:0@lo:503: 00000100:00100000:2.0:1784404607.567127:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8479:1871083728820480:0@lo:502: 00000100:00100000:2.0:1784404607.567227:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.567270:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aede40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.567393:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820480 00000100:00100000:1.0:1784404607.567410:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820480 00000100:00100000:1.0:1784404607.567461:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784404607.567471:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8479:x1871083728820480:12345-0@lo:502: 00000100:00100000:1.0:1784404607.567621:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8479:x1871083728820480:12345-0@lo:502: Request processed in 150us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.567629:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784404607.568310:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8479:1871083728820480:0@lo:502: 00000100:00100000:2.0:1784404607.568371:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8479:1871083728820608:0@lo:502: 00000100:00100000:2.0:1784404607.569282:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.569332:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aede40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.570000:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820608 00000100:00100000:1.0:1784404607.570009:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820608 00000100:00100000:1.0:1784404607.570113:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784404607.570124:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8479:x1871083728820608:12345-0@lo:502: 00000100:00100000:1.0:1784404607.570284:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:8479:x1871083728820608:12345-0@lo:502: Request processed in 161us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.570292:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784404607.570374:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8479:1871083728820608:0@lo:502: 00000040:00080000:2.0:1784404607.570414:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784404607.583297:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784404607.583336:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784404607.583345:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.583356:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404607.583377:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784404607.583379:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd565e88000 from 5 10000000:01000000:0.0:1784404607.583381:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784404607.583438:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.583446:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.583457:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.583480:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820736:0@lo:101: 00000100:00100000:0.0:1784404607.583559:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.583592:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.583607:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820736 00000100:00100000:0.0:1784404607.583612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820736 00000100:00100000:0.0:1784404607.583641:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784404607.583646:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728820736:12345-0@lo:101: 00010000:00010000:0.0:1784404607.583657:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404607.583666:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78b5f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.583684:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.583691:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.583706:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540030800, rc 0) 00000100:00100000:0.0:1784404607.583743:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728820736:12345-0@lo:101: Request processed in 95us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.583750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784404607.584325:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820736:0@lo:101: 00010000:00010000:0.0:1784404607.584338:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.584345:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.584384:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820864:0@lo:256: 00000100:00100000:0.0:1784404607.584683:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.584698:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.584712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820864 00000100:00100000:0.0:1784404607.584715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820864 00000100:00100000:0.0:1784404607.584740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784404607.584747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728820864:12345-0@lo:256: 20000000:01000000:0.0:1784404607.584763:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784404607.585258:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784404607.585262:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784404607.585719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728820864:12345-0@lo:256: Request processed in 970us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.585729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784404607.586264:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820864:0@lo:256: 10000000:01000000:0.0:1784404607.586321:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784404607.586330:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.586353:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404607.586363:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784404607.586366:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1784404607.586369:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784404607.587050:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.587061:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.587071:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.587095:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820992:0@lo:101: 00000100:00100000:0.0:1784404607.587144:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.587177:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.587300:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728820992 00000100:00100000:1.0:1784404607.587309:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728820992 00000100:00100000:1.0:1784404607.587362:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784404607.587371:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728820992:12345-0@lo:101: 00010000:00010000:1.0:1784404607.587384:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404607.587513:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78b6d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.587537:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.587547:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.587555:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d208a00, rc 0) 00000100:00100000:1.0:1784404607.596311:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728820992:12345-0@lo:101: Request processed in 8926us (9151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.596325:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784404607.601531:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728820992:0@lo:101: 00010000:00010000:0.0:1784404607.601560:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.601571:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.601644:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728821120:0@lo:501: 00000100:00100000:0.0:1784404607.601701:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.601752:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.602150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728821120 00000100:00100000:1.0:1784404607.602155:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728821120 00000100:00100000:1.0:1784404607.602252:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784404607.602261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728821120:12345-0@lo:501: 00000100:00100000:1.0:1784404607.602680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728821120:12345-0@lo:501: Request processed in 420us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.602686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784404607.602772:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728821120:0@lo:501: 00000100:00100000:0.0:1784404607.602907:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728821248:0@lo:503: 00000100:00100000:0.0:1784404607.602952:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.602977:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.603278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728821248 00000100:00100000:1.0:1784404607.603283:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728821248 00000100:00100000:1.0:1784404607.603312:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784404607.603320:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728821248:12345-0@lo:503: 00000100:00100000:1.0:1784404607.603470:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728821248:12345-0@lo:503: Request processed in 151us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.603477:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784404607.603535:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728821248:0@lo:503: 00000100:00100000:0.0:1784404607.604154:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8480:1871083728821376:0@lo:502: 00000100:00100000:0.0:1784404607.604443:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.604471:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510afa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.604532:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728821376 00000100:00100000:1.0:1784404607.604538:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728821376 00000100:00100000:1.0:1784404607.604570:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784404607.604576:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:8480:x1871083728821376:12345-0@lo:502: 00000100:00100000:1.0:1784404607.605102:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:8480:x1871083728821376:12345-0@lo:502: Request processed in 525us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.605108:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784404607.608480:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8480:1871083728821376:0@lo:502: 00000020:01000000:2.0:1784404607.608761:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784404607.608768:0:8480:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1784404607.608884:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.608887:0:8480:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784404607.608893:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784404607.608896:0:8480:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:2.0:1784404607.608918:0:8480:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1784404607.608920:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404607.608936:0:8480:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dd574c14d40) 00000020:00000080:2.0:1784404607.608961:0:8480:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1784404607.608967:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784404607.610308:0:8480:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1784404607.610322:0:8480:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784404607.610331:0:8480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd78b82 00010000:00080000:2.0:1784404607.610399:0:8480:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd57df4f800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404607.610619:0:8480:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1784404607.618438:0:8480:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784404607.618465:0:8480:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1784404607.618748:0:8480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784404607.619015:0:8480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784404607.619126:0:8480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1784404607.619217:0:8480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1784404607.620160:0:8482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784404607.620165:0:8482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784404607.621287:0:8480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784404607.621301:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784404607.621342:0:8480:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784404607.621370:0:8480:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd78b89 00000100:00080000:0.0:1784404607.621381:0:8480:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784404607.621387:0:8480:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd57df4f800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404607.621554:0:8480:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd441abfb80 x1871083728821504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784404607.621584:0:8480:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784404607.621650:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404607.621655:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404607.621657:0:8480:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784404607.621660:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404607.621665:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404607.621666:0:8480:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784404607.621669:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784404607.621671:0:8480:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784404607.621700:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8480:1871083728821632:0@lo:502: 00000100:00100000:0.0:1784404607.621782:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.621795:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728821504:0@lo:8: 00000100:00100000:0.0:1784404607.621832:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510afc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.621833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.621903:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728821504 00000100:00100000:0.0:1784404607.621911:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728821504 00000100:00100000:1.0:1784404607.622286:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728821632 00000100:00100000:1.0:1784404607.622291:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728821632 00000100:00100000:1.0:1784404607.622344:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784404607.622355:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:8480:x1871083728821632:12345-0@lo:502: 00000100:00100000:1.0:1784404607.622605:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:8480:x1871083728821632:12345-0@lo:502: Request processed in 251us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.622614:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784404607.622698:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8480:1871083728821632:0@lo:502: 00000020:01000000:2.0:1784404607.622738:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404607.622744:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.622747:0:8480:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784404607.622751:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1784404607.623023:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1784404607.623050:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784404607.623058:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.623066:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404607.623075:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784404607.623077:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd544dfc000 from 30 10000000:01000000:2.0:1784404607.623079:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784404607.623101:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.623107:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404607.623113:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404607.623124:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728821760:0@lo:101: 00000100:00100000:2.0:1784404607.623160:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.623187:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5517620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.623300:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404607.623309:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728821504:12345-0@lo:8: 00010000:00080000:0.0:1784404607.623335:0:8431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1784404607.623362:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd78b97 00002000:00100000:0.0:1784404607.623392:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dd574d7f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784404607.623466:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1784404607.623470:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784404607.623542:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784404607.623749:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1784404607.623775:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404607.623839:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083728821504:12345-0@lo:8: Request processed in 530us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.623847:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784404607.623976:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd441abfb80 x1871083728821504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.623978:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728821760 00000100:00100000:1.0:1784404607.623985:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728821760 00000100:00100000:2.0:1784404607.623990:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404607.623997:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784404607.624003:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784404607.624007:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784404607.624009:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57df4f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784404607.624021:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784404607.624026:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728821504:0@lo:8: 00000100:00100000:1.0:1784404607.624029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784404607.624044:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728821760:12345-0@lo:101: 00000004:00080000:2.0:1784404607.624049:0:8482:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:1.0:1784404607.624053:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404607.624067:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78b90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.624089:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784404607.624095:0:8482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 225508242494ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784404607.624101:0:8482:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:1.0:1784404607.624102:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.624112:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209a00, rc 0) 00000100:00100000:2.0:1784404607.624137:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728821888:0@lo:700: 00000100:00100000:1.0:1784404607.624152:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728821760:12345-0@lo:101: Request processed in 109us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.624159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784404607.624168:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.624195:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728821888 00000100:00100000:2.0:1784404607.624197:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728821888 00000100:00100000:2.0:1784404607.624219:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784404607.624224:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8483:x1871083728821888:12345-0@lo:700: 00000100:00100000:2.0:1784404607.624242:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1871083728822016:0@lo:700: 00000100:00100000:2.0:1784404607.624260:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.624283:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.624289:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728821760:0@lo:101: 00000100:00100000:2.0:1784404607.624300:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762f00 going to sleep for 11 seconds 00010000:00010000:1.0:1784404607.624305:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.624316:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404607.624366:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822144:0@lo:501: 00000100:00100000:1.0:1784404607.624391:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.624483:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548556600 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.624490:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822144 00000100:00100000:2.0:1784404607.624507:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822144 00000100:00100000:2.0:1784404607.624542:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784404607.624557:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728822144:12345-0@lo:501: 00000100:00100000:2.0:1784404607.624641:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728822144:12345-0@lo:501: Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.625761:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822016 00000100:00100000:3.0:1784404607.625770:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822016 00000100:00100000:3.0:1784404607.625814:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404607.625825:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1871083728822016:12345-0@lo:700: 00000100:00080000:0.0:1784404607.626148:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404607.626174:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404607.626664:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822144:0@lo:501: 00000100:00100000:2.0:1784404607.626665:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784404607.626721:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822272:0@lo:503: 00000100:00100000:1.0:1784404607.626788:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.626829:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548556600 going to sleep for 11 seconds 00000004:00080000:2.0:1784404607.627543:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1784404607.627616:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822272 00000100:00100000:3.0:1784404607.627623:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822272 00000100:00100000:3.0:1784404607.627664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784404607.627674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728822272:12345-0@lo:503: 00000100:00100000:3.0:1784404607.627809:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728822272:12345-0@lo:503: Request processed in 136us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.627817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784404607.627890:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822272:0@lo:503: 40000000:02000000:2.0:1784404607.629662:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1784404607.631638:0:8484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8484:1871083728822400:0@lo:502: 00000100:00100000:0.0:1784404607.631717:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.631796:0:8484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.637046:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822400 00000100:00100000:3.0:1784404607.637060:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822400 00000100:00100000:3.0:1784404607.638088:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784404607.638104:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:8484:x1871083728822400:12345-0@lo:502: 00000100:00100000:3.0:1784404607.638298:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:8484:x1871083728822400:12345-0@lo:502: Request processed in 199us (6580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.638306:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784404607.638600:0:8484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8484:1871083728822400:0@lo:502: 00000100:00100000:0.0:1784404607.638667:0:8484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8484:1871083728822528:0@lo:502: 00000100:00100000:0.0:1784404607.638712:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.639761:0:8484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.639905:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1871083728822016:12345-0@lo:700: Request processed in 14080us (15640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.639915:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784404607.640023:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd570590000 x1871083728822016/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404607.640036:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1871083728822016:0@lo:700: 40000000:02000000:0.0:1784404607.640053:0:8440:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1784404607.644657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822528 00000100:00100000:1.0:1784404607.644678:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822528 00000100:00100000:1.0:1784404607.644749:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784404607.644760:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:8484:x1871083728822528:12345-0@lo:502: 00000100:00100000:1.0:1784404607.648183:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:8484:x1871083728822528:12345-0@lo:502: Request processed in 3417us (9462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.648210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784404607.648893:0:8484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8484:1871083728822528:0@lo:502: 00000040:00080000:0.0:1784404607.649153:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784404607.649375:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784404607.649410:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784404607.649421:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.649432:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404607.649457:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784404607.649460:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd544dfc000 from 5 10000000:01000000:3.0:1784404607.649463:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784404607.649506:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.649514:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.649524:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404607.649543:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822656:0@lo:101: 00000100:00100000:3.0:1784404607.649590:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.649630:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.649731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822656 00000100:00100000:1.0:1784404607.649739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822656 00000100:00100000:1.0:1784404607.649783:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784404607.649793:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728822656:12345-0@lo:101: 00010000:00010000:1.0:1784404607.649805:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404607.649818:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.649841:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.649881:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404607.649891:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d208200, rc 0) 00000100:00100000:1.0:1784404607.649942:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728822656:12345-0@lo:101: Request processed in 150us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.649948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784404607.650133:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822656:0@lo:101: 00010000:00010000:0.0:1784404607.650147:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.650156:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.650276:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822784:0@lo:256: 00000100:00100000:0.0:1784404607.650313:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.650337:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510afd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.650379:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822784 00000100:00100000:3.0:1784404607.650383:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822784 00000100:00100000:3.0:1784404607.650482:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784404607.650490:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728822784:12345-0@lo:256: 20000000:01000000:3.0:1784404607.650517:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784404607.650536:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784404607.650540:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784404607.650627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728822784:12345-0@lo:256: Request processed in 138us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.650634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784404607.650728:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822784:0@lo:256: 10000000:01000000:0.0:1784404607.650771:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784404607.650778:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.650785:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404607.650794:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784404607.650795:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1784404607.650798:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784404607.650816:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.650824:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.650842:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.650885:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822912:0@lo:101: 00000100:00100000:0.0:1784404607.650910:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.651051:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728822912 00000100:00100000:3.0:1784404607.651056:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728822912 00000100:00100000:3.0:1784404607.651091:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784404607.651104:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728822912:12345-0@lo:101: 00010000:00010000:3.0:1784404607.651113:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404607.651122:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78bb3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.651138:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.651146:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.651153:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821da400, rc 0) 00000001:00100000:1.0:1784404607.653231:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1784404607.653579:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728822912:12345-0@lo:101: Request processed in 2470us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.653590:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784404607.653739:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510afd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.653766:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728822912:0@lo:101: 00010000:00010000:0.0:1784404607.653787:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404607.653799:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404607.653895:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728823040:0@lo:501: 00000100:00100000:0.0:1784404607.654009:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.654028:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510afd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.654094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823040 00000100:00100000:3.0:1784404607.654101:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823040 00000100:00100000:3.0:1784404607.654147:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784404607.654157:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728823040:12345-0@lo:501: 00000100:00100000:3.0:1784404607.654362:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728823040:12345-0@lo:501: Request processed in 206us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.654369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784404607.654480:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728823040:0@lo:501: 00000100:00100000:3.0:1784404607.654525:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728823168:0@lo:503: 00000100:00100000:3.0:1784404607.654571:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.654593:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.654605:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823168 00000100:00100000:3.0:1784404607.654616:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823168 00000100:00100000:3.0:1784404607.654640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784404607.654647:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728823168:12345-0@lo:503: 00000100:00100000:3.0:1784404607.654721:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728823168:12345-0@lo:503: Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.654728:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784404607.654767:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728823168:0@lo:503: 00000100:00100000:2.0:1784404607.655515:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8483:x1871083728821888:12345-0@lo:700: Request processed in 31287us (31345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.655527:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784404607.655822:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8485:1871083728823296:0@lo:502: 00000100:00100000:2.0:1784404607.655907:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.655941:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762780 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.656055:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823296 00000100:00100000:3.0:1784404607.656061:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823296 00000100:00100000:3.0:1784404607.656096:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784404607.656105:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:8485:x1871083728823296:12345-0@lo:502: 00000100:00100000:3.0:1784404607.656224:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:8485:x1871083728823296:12345-0@lo:502: Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.656230:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784404607.656383:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8485:1871083728823296:0@lo:502: 00000020:01000000:2.0:1784404607.656484:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784404607.656493:0:8485:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784404607.656511:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404607.656514:0:8485:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784404607.656519:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784404607.656524:0:8485:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:2.0:1784404607.656545:0:8485:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784404607.656548:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404607.656576:0:8485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dd573b18000) 00000020:00000080:2.0:1784404607.657014:0:8485:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1784404607.657028:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784404607.657115:0:8485:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784404607.657120:0:8485:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784404607.657125:0:8485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd78bc8 00010000:00080000:2.0:1784404607.657157:0:8485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd577f06800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404607.657506:0:8485:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:0.0:1784404607.658552:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd570591180 x1871083728821888/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404607.658568:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728821888:0@lo:700: 00000004:00080000:2.0:1784404607.665021:0:8483:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784404607.665055:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728823552:0@lo:7: 00000100:00100000:2.0:1784404607.665120:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.665154:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762780 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.665219:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728823424:0@lo:13: 00000100:00100000:3.0:1784404607.665251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.665299:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823552 00000100:00100000:3.0:1784404607.665306:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823552 00000100:00100000:3.0:1784404607.665346:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404607.665353:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8483:x1871083728823552:12345-0@lo:7: 00000100:00100000:2.0:1784404607.665532:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823424 00000100:00100000:2.0:1784404607.665536:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823424 00000100:00100000:2.0:1784404607.665559:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784404607.665565:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728823424:12345-0@lo:13: 00002000:00000024:2.0:1784404607.665576:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:2.0:1784404607.665625:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728823424:12345-0@lo:13: Request processed in 59us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.665632:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1784404607.668233:0:8485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784404607.668255:0:8485:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784404607.668410:0:8485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404607.668593:0:8485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404607.668691:0:8485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784404607.668783:0:8485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00010000:00080000:2.0:1784404607.673081:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd570593100 x1871083728823424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404607.673108:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728823424:0@lo:13: 00002000:00080000:3.0:1784404607.673742:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1784404607.673749:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000040:00080000:1.0:1784404607.674293:0:8486:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404607.674298:0:8486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784404607.675045:0:8485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784404607.675057:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784404607.675091:0:8485:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784404607.675116:0:8485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd78bcf 00000100:00080000:1.0:1784404607.675125:0:8485:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784404607.675131:0:8485:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd577f06800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404607.675163:0:8485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b9b100 x1871083728823680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404607.675198:0:8485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784404607.675275:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404607.675279:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404607.675281:0:8485:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784404607.675285:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404607.675289:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404607.675290:0:8485:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784404607.675293:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784404607.675295:0:8485:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784404607.675321:0:8485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8485:1871083728823808:0@lo:502: 00000100:00100000:1.0:1784404607.675384:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.675558:0:8485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.675625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728823680:0@lo:8: 00000100:00100000:0.0:1784404607.675669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.675749:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784404607.675756:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1784404607.680373:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823680 00000100:00100000:0.0:1784404607.680389:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823680 00000100:00100000:0.0:1784404607.680640:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784404607.680648:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728823680:12345-0@lo:8: 00010000:00080000:0.0:1784404607.680681:0:8431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1784404607.680712:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd78bd6 00002000:00100000:0.0:1784404607.680729:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dd441a62000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784404607.680733:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784404607.680736:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784404607.680825:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784404607.680884:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd574d79800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404607.681045:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083728823680:12345-0@lo:8: Request processed in 396us (5374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404607.681053:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784404607.681156:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b9b100 x1871083728823680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404607.681168:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404607.681176:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784404607.681250:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784404607.681257:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784404607.681267:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd577f06800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784404607.681288:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784404607.681295:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728823680:0@lo:8: 00000004:00080000:2.0:1784404607.681324:0:8486:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784404607.681381:0:8486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 225565529477ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784404607.681387:0:8486:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784404607.682295:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8483:x1871083728823552:12345-0@lo:7: Request processed in 16937us (17170us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.682307:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404607.682340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823808 00000100:00100000:3.0:1784404607.682347:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823808 00000100:00100000:3.0:1784404607.682473:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784404607.682483:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:8485:x1871083728823808:12345-0@lo:502: 00000100:00100000:3.0:1784404607.682623:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:8485:x1871083728823808:12345-0@lo:502: Request processed in 142us (7239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.682631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784404607.682692:0:8485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:8485:1871083728823808:0@lo:502: 00000020:01000000:3.0:1784404607.682727:0:8485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404607.682734:0:8485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404607.682737:0:8485:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784404607.682742:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1784404607.682901:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000004:00080000:2.0:1784404607.685068:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:2.0:1784404607.685139:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd570591180 x1871083728823552/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404607.685155:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728823552:0@lo:7: 00000004:00080000:2.0:1784404607.685166:0:8483:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 10000000:01000000:3.0:1784404607.685277:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784404607.685288:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.685298:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404607.685308:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784404607.685310:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd545b94d40 from 1 10000000:01000000:3.0:1784404607.685313:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784404607.685345:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.685352:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.685361:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404607.685471:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728823936:0@lo:101: 00000100:00100000:3.0:1784404607.685555:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.685594:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546770480 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.685613:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728823936 00000100:00100000:3.0:1784404607.685619:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728823936 00000100:00100000:3.0:1784404607.685658:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784404607.685667:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728823936:12345-0@lo:101: 00010000:00010000:3.0:1784404607.685679:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404607.685692:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78bdd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.685715:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.685725:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.685733:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821dae00, rc 0) 00000100:00100000:3.0:1784404607.685767:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728823936:12345-0@lo:101: Request processed in 101us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.685773:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784404607.685819:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728823936:0@lo:101: 00010000:00010000:3.0:1784404607.685832:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.685841:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404607.685917:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728824064:0@lo:501: 00000100:00100000:2.0:1784404607.686015:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728824192:0@lo:5: 00000100:00100000:2.0:1784404607.686043:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404607.686071:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824192 00000100:00100000:2.0:1784404607.686075:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824192 00000100:00100000:2.0:1784404607.686105:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784404607.686112:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8483:x1871083728824192:12345-0@lo:5: 00002000:00080000:2.0:1784404607.686132:0:8488:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1784404607.686158:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8483:x1871083728824192:12345-0@lo:5: Request processed in 47us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404607.686165:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784404607.686182:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762780 going to sleep for 11 seconds 00010000:00080000:2.0:1784404607.686379:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd570591180 x1871083728824192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404607.686389:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728824192:0@lo:5: 00000004:00080000:2.0:1784404607.686465:0:8483:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784404607.686509:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728824320:0@lo:5: 00000100:00100000:2.0:1784404607.686538:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.686632:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.686660:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.686674:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824064 00000100:00100000:3.0:1784404607.686678:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824064 00000100:00100000:3.0:1784404607.686697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784404607.686704:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728824064:12345-0@lo:501: 00000100:00100000:3.0:1784404607.686777:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728824064:12345-0@lo:501: Request processed in 74us (144us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784404607.686784:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784404607.686812:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728824064:0@lo:501: 10000000:01000000:3.0:1784404607.686839:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784404607.686845:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404607.686876:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404607.687021:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762780 going to sleep for 11 seconds 00000100:00100000:1.0:1784404607.691249:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728824448:0@lo:13: 00000100:00100000:1.0:1784404607.691326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.691390:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824448 00000100:00100000:1.0:1784404607.691690:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824448 00000100:00100000:1.0:1784404607.691787:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404607.691822:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728824448:12345-0@lo:13: 00002000:00000024:1.0:1784404607.691891:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:1.0:1784404607.692309:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728824448:12345-0@lo:13: Request processed in 487us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.692317:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1784404607.692342:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784404607.692374:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b98a80 x1871083728824448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.692392:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728824448:0@lo:13: 00000004:00080000:1.0:1784404607.692539:0:8487:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784404607.692565:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728824576:0@lo:7: 00000100:00100000:1.0:1784404607.692617:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404607.692740:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824320 00000100:00100000:3.0:1784404607.692746:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824320 00000100:00100000:1.0:1784404607.694627:0:8487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.695662:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824576 00000100:00100000:0.0:1784404607.695673:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824576 00000100:00100000:3.0:1784404607.698312:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784404607.698334:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8483:x1871083728824320:12345-0@lo:5: 00002000:00080000:3.0:1784404607.698382:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784404607.700612:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8483:x1871083728824320:12345-0@lo:5: Request processed in 2281us (14065us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784404607.700624:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784404607.700664:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404607.700674:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8487:x1871083728824576:12345-0@lo:7: 00010000:00080000:1.0:1784404607.707528:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd570591180 x1871083728824320/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.707552:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8483:1871083728824320:0@lo:5: 00000004:00080000:1.0:1784404607.707569:0:8483:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1784404607.707621:0:8483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8483:1871083728824704:0@lo:900: 00000100:00100000:1.0:1784404607.707691:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.707735:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824704 00000100:00100000:1.0:1784404607.707742:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824704 00000100:00100000:1.0:1784404607.707797:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404607.707806:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8483:x1871083728824704:12345-0@lo:900: 00000100:00100000:1.0:1784404607.707875:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8483:x1871083728824704:12345-0@lo:900: Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404607.707893:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404607.710002:0:8483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b4240 going to sleep for 11 seconds 00010000:00080000:1.0:1784404607.710041:0:8483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b9b800 x1871083728824704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.710056:0:8483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8483:1871083728824704:0@lo:900: 00002000:00080000:3.0:1784404607.713732:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1784404607.713741:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784404607.714057:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8487:x1871083728824576:12345-0@lo:7: Request processed in 13381us (21434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.714066:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784404607.716109:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b98a80 x1871083728824576/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404607.716127:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728824576:0@lo:7: 00000004:00080000:0.0:1784404607.716143:0:8487:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784404607.716257:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728824832:0@lo:5: 00000100:00100000:0.0:1784404607.716315:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404607.717548:0:8487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404607.720282:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824832 00000100:00100000:2.0:1784404607.720294:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824832 00000100:00100000:2.0:1784404607.720405:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784404607.720415:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8487:x1871083728824832:12345-0@lo:5: 00002000:00080000:2.0:1784404607.720443:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784404607.720447:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1784404607.725554:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1784404607.725572:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1784404607.725578:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784404607.725734:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8487:x1871083728824832:12345-0@lo:5: Request processed in 5317us (9413us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784404607.725746:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784404607.726667:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd441abd500 x1871083728824832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.726682:0:8487:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784404607.726690:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728824832:0@lo:5: 00000004:00080000:1.0:1784404607.726708:0:8487:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784404607.726761:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728824960:0@lo:700: 00000100:00100000:1.0:1784404607.726810:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.726866:0:8487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404607.729374:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728824960 00000100:00100000:0.0:1784404607.729389:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728824960 00000100:00100000:0.0:1784404607.729537:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784404607.729556:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8487:x1871083728824960:12345-0@lo:700: 00000100:00100000:3.0:1784404607.740790:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8487:x1871083728824960:12345-0@lo:700: Request processed in 11227us (13970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404607.740809:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784404607.740939:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b9b800 x1871083728824960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.740956:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728824960:0@lo:700: 00000004:02000040:1.0:1784404607.742611:0:8487:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1784404607.753454:0:8487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728825088:0@lo:5: 00000100:00100000:1.0:1784404607.753538:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404607.753583:0:8487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b4240 going to sleep for 11 seconds 00000100:00100000:3.0:1784404607.753753:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825088 00000100:00100000:3.0:1784404607.753760:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825088 00000100:00100000:3.0:1784404607.753816:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404607.753826:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8487:x1871083728825088:12345-0@lo:5: 00002000:00080000:3.0:1784404607.763246:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1784404607.763265:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1784404607.765328:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8487:x1871083728825088:12345-0@lo:5: Request processed in 11498us (11784us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784404607.765340:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784404607.766052:0:8487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b9b800 x1871083728825088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404623 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404607.766081:0:8487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8487:1871083728825088:0@lo:5: 00000004:00080000:1.0:1784404607.766097:0:8487:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:0.0:1784404608.030771:0:8518:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404608.031032:0:8518:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784404608.260435:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404609.284395:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404609.411038:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404609.411075:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728825216:0@lo:41: 00000100:00100000:2.0:1784404609.411142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404609.411218:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825216 00000100:00100000:2.0:1784404609.411538:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825216 00000100:00100000:2.0:1784404609.411623:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784404609.411633:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728825216:12345-0@lo:41: 00000004:00000024:2.0:1784404609.411668:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1784404609.411721:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728825216:12345-0@lo:41: Request processed in 90us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404609.411728:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784404609.413325:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728825216:0@lo:41: 00010000:00010000:0.0:1784404610.311163:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404610.437353:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728825344:0@lo:41: 00000100:00100000:0.0:1784404610.437424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404610.437572:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825344 00000100:00100000:1.0:1784404610.437580:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825344 00000100:00100000:1.0:1784404610.437635:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404610.437645:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728825344:12345-0@lo:41: 00000004:00000024:1.0:1784404610.437679:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1784404610.437725:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728825344:12345-0@lo:41: Request processed in 83us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404610.437732:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784404610.437810:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728825344:0@lo:41: 00010000:00010000:3.0:1784404611.331400:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404612.355407:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404612.997105:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728825856:0@lo:400: 00000100:00100000:1.0:1784404612.997486:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728825600:0@lo:400: 00000100:00100000:3.0:1784404612.997900:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728825472:0@lo:13: 00000100:00100000:1.0:1784404613.000004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.000062:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728826112:0@lo:400: 00000100:00100000:1.0:1784404613.000091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.000107:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728826624:0@lo:400: 00000100:00100000:1.0:1784404613.000125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.000148:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784404613.000154:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728825728:0@lo:400: 00000100:00100000:1.0:1784404613.000173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.000202:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728826240:0@lo:400: 00000100:00100000:1.0:1784404613.000221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.000236:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728826752:0@lo:13: 00000100:00100000:1.0:1784404613.000254:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.000286:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825600 00000100:00100000:1.0:1784404613.000299:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825600 00000100:00100000:1.0:1784404613.000339:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784404613.000346:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3648:x1871083728825600:12345-0@lo:400: 00000100:00100000:1.0:1784404613.000388:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3648:x1871083728825600:12345-0@lo:400: Request processed in 43us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.000395:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784404613.000423:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728826112 00000100:00100000:1.0:1784404613.000426:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728826112 00000100:00100000:1.0:1784404613.000462:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404613.000470:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728826112:12345-0@lo:400: 00000100:00100000:1.0:1784404613.000503:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728826112:12345-0@lo:400: Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.000509:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404613.000528:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825728 00000100:00100000:1.0:1784404613.000531:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825728 00000100:00100000:1.0:1784404613.000570:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728826240 00000100:00100000:1.0:1784404613.000573:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728826240 00000100:00100000:3.0:1784404613.000767:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404613.000798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728825984:0@lo:400: 00000100:00100000:3.0:1784404613.000830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404613.000867:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728826496:0@lo:400: 00000100:00100000:3.0:1784404613.000893:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.000906:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825984 00000100:00100000:1.0:1784404613.000911:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825984 00000100:00100000:1.0:1784404613.000935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404613.000941:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728826624 00000100:00100000:1.0:1784404613.000945:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728825728:12345-0@lo:400: 00000100:00100000:3.0:1784404613.000948:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728826624 00000100:00100000:3.0:1784404613.000985:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728826496 00000100:00100000:3.0:1784404613.000989:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728826496 00000100:00100000:1.0:1784404613.001001:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728825728:12345-0@lo:400: Request processed in 59us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.001008:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404613.001016:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404613.001024:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728826624:12345-0@lo:400: 00000100:00100000:1.0:1784404613.001029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404613.001039:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728826240:12345-0@lo:400: 00000100:00100000:3.0:1784404613.001072:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728826624:12345-0@lo:400: Request processed in 49us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.001083:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728826240:12345-0@lo:400: Request processed in 45us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.001099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404613.001112:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404613.001117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728825984:12345-0@lo:400: 00000100:00100000:1.0:1784404613.001151:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728825984:12345-0@lo:400: Request processed in 34us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.001157:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404613.001180:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728826752 00000100:00100000:1.0:1784404613.001184:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728826752 00000100:00100000:1.0:1784404613.001319:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825472 00000100:00100000:1.0:1784404613.001323:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825472 00000100:00100000:1.0:1784404613.001335:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404613.001340:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083728826752:12345-0@lo:13: 00002000:00000024:1.0:1784404613.001360:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404613.001395:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083728826752:12345-0@lo:13: Request processed in 54us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.001400:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404613.001411:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404613.001417:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728825472:12345-0@lo:13: 00002000:00000024:1.0:1784404613.001426:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404613.001460:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728825472:12345-0@lo:13: Request processed in 32us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.001465:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1784404613.001485:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404613.001491:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404613.001504:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404613.001511:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728826496:12345-0@lo:400: 00000100:00100000:1.0:1784404613.001830:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728826496:12345-0@lo:400: Request processed in 40us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.001837:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784404613.001902:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442555c00 x1871083728825728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404613.001916:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728825728:0@lo:400: 00010000:00080000:1.0:1784404613.001926:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442556300 x1871083728826240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404613.001933:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728826240:0@lo:400: 00010000:00080000:1.0:1784404613.001943:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd441abd500 x1871083728826752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404613.001955:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728826752:0@lo:13: 00000100:00100000:1.0:1784404613.002034:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728825600:0@lo:400: 00000100:00100000:1.0:1784404613.002045:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728826112:0@lo:400: 00010000:00080000:1.0:1784404613.002055:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442554a80 x1871083728826624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404613.002064:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728826624:0@lo:400: 00010000:00080000:1.0:1784404613.002102:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd565e6f800 x1871083728825472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404613.002110:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784404613.002122:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728825472:0@lo:13: 00010000:00080000:1.0:1784404613.002132:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442556680 x1871083728825984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404613.002148:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728825984:0@lo:400: 00010000:00080000:1.0:1784404613.002161:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442555880 x1871083728826496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404613.002169:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728826496:0@lo:400: 00000100:00100000:3.0:1784404613.002334:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404613.003305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404613.003351:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728826368:0@lo:400: 00000100:00100000:1.0:1784404613.003355:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728825856 00000100:00100000:1.0:1784404613.003363:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728825856 00000100:00100000:0.0:1784404613.003396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404613.003408:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404613.003419:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728825856:12345-0@lo:400: 00000100:00100000:0.0:1784404613.003435:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728826368 00000100:00100000:0.0:1784404613.003440:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728826368 00000100:00100000:1.0:1784404613.003491:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728825856:12345-0@lo:400: Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404613.003501:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784404613.003505:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784404613.003515:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728826368:12345-0@lo:400: 00000100:00080000:1.0:1784404613.003537:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404613.003544:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728826368:12345-0@lo:400: Request processed in 33us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404613.003549:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404613.003584:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728825856:0@lo:400: 00010000:00080000:0.0:1784404613.003635:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442554700 x1871083728826368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404613.003648:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728826368:0@lo:400: 00000001:00080000:3.0:1784404613.004490:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:02000400:2.0:1784404613.096391:0:8808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784404613.379129:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784404614.017042:0:8860:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404614.017278:0:8860:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784404614.403834:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404614.533493:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728826880:0@lo:41: 00000100:00100000:2.0:1784404614.533573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404614.534226:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728826880 00000100:00100000:1.0:1784404614.534234:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728826880 00000100:00100000:1.0:1784404614.534327:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784404614.534347:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728826880:12345-0@lo:41: 00000004:00000024:1.0:1784404614.534387:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784404614.534654:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728826880:12345-0@lo:41: Request processed in 317us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404614.534662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784404614.534779:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728826880:0@lo:41: 00010000:00010000:3.0:1784404615.427025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404615.558220:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404615.558252:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728827008:0@lo:41: 00000100:00100000:2.0:1784404615.558336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404615.558702:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827008 00000100:00100000:3.0:1784404615.558711:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827008 00000100:00100000:3.0:1784404615.558757:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784404615.558766:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728827008:12345-0@lo:41: 00000004:00000024:3.0:1784404615.558800:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1784404615.558942:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728827008:0@lo:41: 00000100:00100000:3.0:1784404615.559081:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728827008:12345-0@lo:41: Request processed in 315us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404615.559088:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1784404616.456703:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784404616.579626:0:8961:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404616.582503:0:8961:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784404617.475587:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784404617.521984:0:9009:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404617.522000:0:9009:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1784404618.119079:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404618.119116:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728827136:0@lo:13: 00000100:00100000:1.0:1784404618.119181:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404618.119245:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827136 00000100:00100000:1.0:1784404618.119268:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827136 00000100:00100000:1.0:1784404618.119317:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404618.119327:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728827136:12345-0@lo:13: 00002000:00000024:1.0:1784404618.119356:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404618.119401:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728827136:12345-0@lo:13: Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404618.119421:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1784404618.119444:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784404618.119476:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442556680 x1871083728827136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404618.119496:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728827136:0@lo:13: 00000100:00100000:2.0:1784404618.119728:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728827392:0@lo:400: 00000100:00100000:2.0:1784404618.119761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404618.119783:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728827904:0@lo:400: 00000100:00100000:2.0:1784404618.119805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404618.119825:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784404618.119831:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728827520:0@lo:400: 00000100:00100000:2.0:1784404618.119892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404618.119912:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728828032:0@lo:400: 00000100:00100000:2.0:1784404618.119933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404618.119964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827392 00000100:00100000:2.0:1784404618.119969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827392 00000100:00100000:2.0:1784404618.119991:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827904 00000100:00100000:2.0:1784404618.119995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827904 00000100:00100000:2.0:1784404618.120015:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828032 00000100:00100000:2.0:1784404618.120019:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828032 00000100:00100000:2.0:1784404618.120035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404618.120041:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728827392:12345-0@lo:400: 00000100:00100000:2.0:1784404618.120082:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728827392:12345-0@lo:400: Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404618.120100:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404618.120123:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404618.120129:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728827904:12345-0@lo:400: 00000100:00100000:2.0:1784404618.120158:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728827904:12345-0@lo:400: Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404618.120164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404618.120176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404618.120182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728828032:12345-0@lo:400: 00000100:00100000:2.0:1784404618.120210:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728828032:12345-0@lo:400: Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404618.120215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404618.120235:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827520 00000100:00100000:2.0:1784404618.120238:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827520 00000100:00100000:2.0:1784404618.120262:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784404618.120269:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728827520:12345-0@lo:400: 00000100:00100000:2.0:1784404618.120301:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728827520:12345-0@lo:400: Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404618.120306:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1784404618.120327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404618.120329:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404618.120346:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728827520:0@lo:400: 00010000:00080000:2.0:1784404618.120357:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd57c929180 x1871083728828032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404618.120367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728828032:0@lo:400: 00010000:00080000:2.0:1784404618.120379:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd570592d80 x1871083728827392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404618.120389:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728827392:0@lo:400: 00010000:00080000:2.0:1784404618.120422:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd57c928380 x1871083728827904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404618.120430:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728827904:0@lo:400: 00000100:00100000:1.0:1784404618.121291:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728827264:0@lo:400: 00000100:00100000:1.0:1784404618.121349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404618.121390:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728827776:0@lo:400: 00000100:00100000:1.0:1784404618.121423:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404618.121440:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728828288:0@lo:13: 00000100:00100000:1.0:1784404618.121458:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404618.121475:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784404618.121481:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728827648:0@lo:400: 00000100:00100000:1.0:1784404618.121499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404618.121513:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728828160:0@lo:400: 00000100:00100000:1.0:1784404618.121532:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404618.121557:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828160 00000100:00100000:1.0:1784404618.121562:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828160 00000100:00100000:1.0:1784404618.121600:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404618.121607:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728828160:12345-0@lo:400: 00000100:00100000:1.0:1784404618.121654:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728828160:12345-0@lo:400: Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404618.121661:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404618.121685:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827776 00000100:00100000:1.0:1784404618.121688:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827776 00000100:00100000:1.0:1784404618.121711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404618.121717:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728827776:12345-0@lo:400: 00000100:00100000:1.0:1784404618.121746:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728827776:12345-0@lo:400: Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404618.121752:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404618.121769:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828288 00000100:00100000:1.0:1784404618.121772:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828288 00000100:00100000:1.0:1784404618.121793:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404618.121798:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728828288:12345-0@lo:13: 00002000:00000024:1.0:1784404618.121823:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404618.121875:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728828288:12345-0@lo:13: Request processed in 76us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404618.121881:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404618.121900:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827648 00000100:00100000:1.0:1784404618.121904:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827648 00000100:00100000:1.0:1784404618.121925:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784404618.121932:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728827648:12345-0@lo:400: 00000100:00100000:1.0:1784404618.121962:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728827648:12345-0@lo:400: Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404618.121969:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1784404618.122000:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd57c929f80 x1871083728827648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404618.122024:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728827648:0@lo:400: 00010000:00080000:1.0:1784404618.122038:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd57c92aa00 x1871083728828160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404618.122044:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1784404618.122056:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728828160:0@lo:400: 00000100:00100000:1.0:1784404618.122065:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728827776:0@lo:400: 00010000:00080000:1.0:1784404618.122073:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd441abe300 x1871083728828288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404618.122083:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728828288:0@lo:13: 00000100:00100000:0.0:1784404618.122288:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728827264 00000100:00100000:0.0:1784404618.122293:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728827264 00000100:00100000:0.0:1784404618.122343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784404618.122351:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3649:x1871083728827264:12345-0@lo:400: 00000100:00100000:0.0:1784404618.122390:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3649:x1871083728827264:12345-0@lo:400: Request processed in 40us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404618.122396:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784404618.122908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728827264:0@lo:400: 00000100:00080000:2.0:1784404618.123020:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784404618.499736:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404619.525129:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404619.653921:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728828416:0@lo:41: 00000100:00100000:3.0:1784404619.654000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404619.655648:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828416 00000100:00100000:1.0:1784404619.655658:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828416 00000100:00100000:1.0:1784404619.655720:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784404619.655732:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728828416:12345-0@lo:41: 00000004:00000024:1.0:1784404619.655768:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784404619.659443:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728828416:12345-0@lo:41: Request processed in 3699us (5428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404619.659453:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728828416:0@lo:41: 00000100:00100000:1.0:1784404619.659460:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1784404620.547713:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404620.676816:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404620.676904:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728828544:0@lo:41: 00000100:00100000:0.0:1784404620.677092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404620.677217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828544 00000100:00100000:1.0:1784404620.677225:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828544 00000100:00100000:1.0:1784404620.677272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784404620.677291:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728828544:12345-0@lo:41: 00000004:00000024:1.0:1784404620.677324:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1784404620.677373:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728828544:12345-0@lo:41: Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404620.677396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784404620.677834:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728828544:0@lo:41: 00010000:00010000:3.0:1784404621.571418:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404622.608156:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404623.234964:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404623.234986:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728828672:0@lo:13: 00000100:00100000:1.0:1784404623.235049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404623.235100:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728828800:0@lo:13: 00000100:00100000:1.0:1784404623.235122:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404623.235155:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828672 00000100:00100000:1.0:1784404623.235162:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828672 00000100:00100000:1.0:1784404623.235203:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828800 00000100:00100000:1.0:1784404623.235206:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828800 00000100:00100000:1.0:1784404623.235224:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404623.235231:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728828672:12345-0@lo:13: 00002000:00000024:1.0:1784404623.235259:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404623.235299:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728828672:12345-0@lo:13: Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.235305:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404623.235321:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784404623.235327:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728828800:12345-0@lo:13: 00002000:00000024:1.0:1784404623.235335:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404623.235368:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728828800:12345-0@lo:13: Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.235374:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1784404623.235391:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784404623.235416:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd565e16300 x1871083728828800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404623.235433:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728828800:0@lo:13: 00010000:00080000:1.0:1784404623.235452:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442554000 x1871083728828672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404623.235463:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728828672:0@lo:13: 00000100:00100000:1.0:1784404623.239170:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728829056:0@lo:400: 00000100:00100000:1.0:1784404623.239236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404623.239262:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728829568:0@lo:400: 00000100:00100000:1.0:1784404623.239296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404623.239315:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784404623.239318:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728828928:0@lo:400: 00000100:00100000:1.0:1784404623.239338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404623.239367:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728829440:0@lo:400: 00000100:00100000:1.0:1784404623.239390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404623.239423:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829056 00000100:00100000:1.0:1784404623.239431:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829056 00000100:00100000:1.0:1784404623.239477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829568 00000100:00100000:1.0:1784404623.239480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829568 00000100:00100000:1.0:1784404623.239507:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784404623.239515:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728829056:12345-0@lo:400: 00000100:00100000:1.0:1784404623.239568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728829056:12345-0@lo:400: Request processed in 54us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.239575:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784404623.239593:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404623.239598:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728829568:12345-0@lo:400: 00000100:00100000:1.0:1784404623.239624:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728829568:12345-0@lo:400: Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.239629:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404623.242501:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829440 00000100:00100000:1.0:1784404623.242519:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829440 00000100:00100000:1.0:1784404623.242578:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784404623.242588:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728829440:12345-0@lo:400: 00000100:00100000:1.0:1784404623.242687:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728829440:12345-0@lo:400: Request processed in 101us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.242694:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784404623.242816:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728829184:0@lo:400: 00000100:00100000:3.0:1784404623.242879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404623.242908:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728829696:0@lo:400: 00000100:00100000:1.0:1784404623.242931:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829184 00000100:00100000:3.0:1784404623.242935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404623.242936:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829184 00000100:00100000:3.0:1784404623.242955:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404623.242961:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728829312:0@lo:400: 00000100:00100000:3.0:1784404623.242983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404623.243014:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728828928 00000100:00100000:3.0:1784404623.243018:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728828928 00000100:00100000:3.0:1784404623.243055:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784404623.243062:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3647:x1871083728828928:12345-0@lo:400: 00000100:00100000:3.0:1784404623.243096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3647:x1871083728828928:12345-0@lo:400: Request processed in 35us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404623.243102:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784404623.243324:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404623.243333:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728829184:12345-0@lo:400: 00000100:00100000:1.0:1784404623.243380:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728829184:12345-0@lo:400: Request processed in 49us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.243386:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404623.243403:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829696 00000100:00100000:1.0:1784404623.243406:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829696 00000100:00100000:1.0:1784404623.243434:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829312 00000100:00100000:1.0:1784404623.243437:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829312 00000100:00100000:1.0:1784404623.243450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784404623.243456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728829696:12345-0@lo:400: 00000100:00100000:1.0:1784404623.243486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728829696:12345-0@lo:400: Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.243493:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784404623.243504:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784404623.243509:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728829312:12345-0@lo:400: 00000100:00100000:1.0:1784404623.243535:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728829312:12345-0@lo:400: Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404623.243541:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1784404623.243580:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442555880 x1871083728829312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404623.243580:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404623.243584:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404623.243595:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728829312:0@lo:400: 00000100:00100000:1.0:1784404623.243613:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728828928:0@lo:400: 00000100:00100000:1.0:1784404623.243625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728829440:0@lo:400: 00000100:00100000:3.0:1784404623.243627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728829184:0@lo:400: 00010000:00080000:3.0:1784404623.243635:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b9b800 x1871083728829696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1784404623.243637:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442555f80 x1871083728829056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404623.243644:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728829696:0@lo:400: 00000100:00100000:1.0:1784404623.243646:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728829056:0@lo:400: 00010000:00080000:1.0:1784404623.243655:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd442554e00 x1871083728829568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404623.243662:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728829568:0@lo:400: 00010000:00010000:3.0:1784404623.619086:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404624.644015:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404624.776819:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404624.776879:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728829824:0@lo:41: 00000100:00100000:3.0:1784404624.776955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404624.777020:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829824 00000100:00100000:3.0:1784404624.777027:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829824 00000100:00100000:3.0:1784404624.777071:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784404624.777080:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728829824:12345-0@lo:41: 00000004:00000024:3.0:1784404624.777116:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784404624.777158:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728829824:12345-0@lo:41: Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404624.777165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784404624.777209:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728829824:0@lo:41: 00010000:00010000:3.0:1784404625.668839:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404625.795030:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404625.795058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728829952:0@lo:41: 00000100:00100000:0.0:1784404625.795135:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404625.795207:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728829952 00000100:00100000:0.0:1784404625.795214:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728829952 00000100:00100000:0.0:1784404625.795259:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784404625.795268:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728829952:12345-0@lo:41: 00000004:00000024:0.0:1784404625.795302:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1784404625.795359:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728829952:12345-0@lo:41: Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404625.795367:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784404625.795412:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728829952:0@lo:41: 00000020:01000004:1.0:1784404626.240647:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784404626.240652:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784404626.240654:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784404626.240822:0:9509:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd442280800 00000020:01000004:1.0:1784404626.240841:0:9509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784404626.240891:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784404626.240908:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dd4421399c0) 00000020:00000080:1.0:1784404626.240927:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784404626.330100:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1784404626.330152:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1784404626.368312:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784404626.368598:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1784404626.368623:0:9509:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784404626.368636:0:9509:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b3e2e6dcd78bf2 00000020:01000004:0.0:1784404626.368644:0:9509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784404626.368669:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784404626.368672:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784404626.368678:0:9509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1784404626.368708:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1784404626.368712:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784404626.399106:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784404626.399154:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1784404626.399159:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784404626.399160:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784404626.399162:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404626.399163:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404626.399164:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404626.399166:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404626.399167:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784404626.399169:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784404626.399170:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784404626.399172:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404626.399174:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784404626.399178:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1784404626.399180:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784404626.399182:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784404626.399183:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404626.399184:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404626.399185:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404626.399187:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404626.399187:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784404626.399188:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784404626.399194:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784404626.399195:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404626.399196:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784404626.399297:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784404626.399317:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728830080:0@lo:253: 00000100:00100000:3.0:1784404626.399547:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.399654:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404626.399761:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830080 00000100:00100000:1.0:1784404626.399769:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830080 00000100:00100000:1.0:1784404626.399883:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784404626.399893:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:9509:x1871083728830080:12345-0@lo:253: 20000000:01000000:1.0:1784404626.399922:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784404626.399926:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1784404626.399930:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1784404626.399934:0:6513:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1784404626.400185:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404626.400318:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1784404626.400343:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1784404626.400360:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1784404626.400365:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1784404626.400375:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1784404626.400388:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1784404626.400472:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1784404626.400486:0:6513:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:1.0:1784404626.400488:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404626.400502:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1784404626.400508:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404626.400523:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1784404626.400529:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404626.400542:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1784404626.400548:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784404626.400560:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1784404626.400574:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1784404626.400641:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1784404626.400652:0:6513:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:1.0:1784404626.400653:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404626.400665:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1784404626.400669:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784404626.400679:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1784404626.400683:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404626.400883:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1784404626.400891:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784404626.400903:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1784404626.400915:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1784404626.401487:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1784404626.401501:0:6513:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.142@tcp 20000000:01000000:1.0:1784404626.401511:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.142@tcp (null) (null) (null) 00000040:00080000:1.0:1784404626.401529:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1784404626.401537:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784404626.401551:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1784404626.401556:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.142@tcp (null) (null) 00000040:00080000:1.0:1784404626.401572:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1784404626.401578:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784404626.401592:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1784404626.401609:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1784404626.401623:0:6513:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784404626.401626:0:6513:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784404626.401630:0:6513:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784404626.401673:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784404626.401677:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784404626.403611:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1784404626.403662:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1784404626.403681:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1784404626.404359:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1784404626.404381:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1784404626.404396:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1784404626.404479:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784404626.404483:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784404626.405102:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1784404626.405125:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1784404626.405141:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1784404626.405377:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1784404626.405396:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1784404626.405490:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1784404626.405501:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784404626.405503:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784404626.406009:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1784404626.406090:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1784404626.406103:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1784404626.406304:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1784404626.406321:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1784404626.406347:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1784404626.406356:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784404626.406359:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784404626.406765:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1784404626.406793:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1784404626.406803:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1784404626.407196:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1784404626.407283:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1784404626.407303:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1784404626.407314:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784404626.407324:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784404626.407819:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1784404626.408152:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1784404626.408173:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1784404626.408188:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1784404626.408204:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784404626.408303:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408323:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408339:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408345:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408352:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408358:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408366:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408372:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408380:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408498:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408521:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 21 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.408537:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830208:0@lo:104: 00000100:00100000:1.0:1784404626.408611:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404626.408716:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.408725:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.408733:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830336:0@lo:104: 00000100:00100000:1.0:1784404626.408753:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404626.409150:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.409159:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 21 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.409167:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830464:0@lo:104: 00000100:00100000:1.0:1784404626.409190:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.409336:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830208 00000100:00100000:2.0:1784404626.409343:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830208 00000100:00100000:2.0:1784404626.409410:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830336 00000100:00100000:2.0:1784404626.409414:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830336 00000100:00100000:2.0:1784404626.409429:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404626.409437:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6513:x1871083728830208:12345-0@lo:104: 00010000:00010000:2.0:1784404626.409450:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409508:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784404626.409514:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6513:x1871083728830208:12345-0@lo:104: Request processed in 77us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.409522:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404626.409542:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404626.409549:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6513:x1871083728830336:12345-0@lo:104: 00010000:00010000:2.0:1784404626.409556:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409589:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784404626.409594:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6513:x1871083728830336:12345-0@lo:104: Request processed in 47us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.409599:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1784404626.409617:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404626.409629:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409637:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dac00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404626.409641:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409650:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404626.409657:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404626.409664:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404626.409704:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409711:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404626.409730:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409737:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78bdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78be4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409751:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404626.409754:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409760:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404626.409762:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409780:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404626.409787:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404626.409792:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404626.409806:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409812:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404626.409826:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409833:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151b800/0x24b3e2e6dcd78bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78bba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.409842:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.409844:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.409846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404626.409887:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728830592:0@lo:103: 00000100:00100000:2.0:1784404626.409917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.409962:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728830720:0@lo:103: 00000100:00100000:2.0:1784404626.409984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.410034:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830592 00000100:00100000:2.0:1784404626.410038:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830592 00010000:00010000:2.0:1784404626.410056:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 22 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.410087:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830720 00000100:00100000:2.0:1784404626.410091:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830720 00010000:00010000:2.0:1784404626.410102:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 23 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.410114:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404626.410119:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:3647:x1871083728830592:12345-0@lo:103: 00010000:00010000:2.0:1784404626.410130:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404626.410136:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 23 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.410147:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 23 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.410162:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404626.410189:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:3647:x1871083728830592:12345-0@lo:103: Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.410195:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404626.410205:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404626.410221:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3648:x1871083728830720:12345-0@lo:103: 00010000:00010000:2.0:1784404626.410229:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404626.410234:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.410242:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.410251:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404626.410277:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3648:x1871083728830720:12345-0@lo:103: Request processed in 67us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.410283:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404626.410312:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728830720:0@lo:103: 00000100:00100000:2.0:1784404626.410343:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728830592:0@lo:103: 00010000:00010000:0.0:1784404626.410408:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404626.411414:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.411428:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.411440:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830848:0@lo:104: 00000100:00100000:1.0:1784404626.411492:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404626.411617:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.411627:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.411636:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830976:0@lo:104: 00000100:00100000:1.0:1784404626.411657:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.411928:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830464 00000100:00100000:2.0:1784404626.411935:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830464 00000100:00100000:2.0:1784404626.411965:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830848 00000100:00100000:2.0:1784404626.411968:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830848 00000100:00100000:2.0:1784404626.411982:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404626.411989:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6513:x1871083728830464:12345-0@lo:104: 00010000:00010000:2.0:1784404626.412000:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.412064:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784404626.412071:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6513:x1871083728830464:12345-0@lo:104: Request processed in 82us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.412077:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404626.412093:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784404626.412098:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6513:x1871083728830848:12345-0@lo:104: 00010000:00010000:2.0:1784404626.412105:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.412149:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784404626.412154:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6513:x1871083728830848:12345-0@lo:104: Request processed in 56us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.412159:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1784404626.412225:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404626.412232:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412239:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404626.412243:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412252:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404626.412259:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404626.412264:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404626.412305:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412312:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404626.412344:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412352:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541390e00/0x24b3e2e6dcd78b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412365:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404626.412368:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412374:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404626.412376:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412383:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404626.412389:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404626.412394:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404626.412419:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412426:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404626.412437:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412444:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b74 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412453:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404626.412459:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404626.412461:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404626.412468:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404626.412632:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728831104:0@lo:103: 00000100:00100000:2.0:1784404626.412665:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404626.412777:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728831104 00000100:00100000:0.0:1784404626.412783:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728831104 00010000:00010000:0.0:1784404626.412806:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 22 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404626.412830:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784404626.412837:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3649:x1871083728831104:12345-0@lo:103: 00010000:00010000:0.0:1784404626.412848:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404626.412871:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 22 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412881:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 22 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.412898:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404626.412926:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3649:x1871083728831104:12345-0@lo:103: Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.412933:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404626.413032:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728831104:0@lo:103: 00000100:00100000:2.0:1784404626.413055:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728831232:0@lo:103: 00000100:00100000:2.0:1784404626.413078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404626.413188:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728831232 00000100:00100000:0.0:1784404626.413192:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728831232 00010000:00010000:0.0:1784404626.413206:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404626.413233:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784404626.413238:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3646:x1871083728831232:12345-0@lo:103: 00010000:00010000:0.0:1784404626.413245:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404626.413249:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.413263:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.413273:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404626.413297:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3646:x1871083728831232:12345-0@lo:103: Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.413303:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784404626.413388:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728831232:0@lo:103: 00010000:00010000:1.0:1784404626.413590:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.413601:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 21 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.413610:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728831360:0@lo:104: 00000100:00100000:1.0:1784404626.413634:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404626.413650:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.413658:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 21 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.413666:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728831488:0@lo:104: 00000100:00100000:1.0:1784404626.413684:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5503d3300 going to sleep for 11 seconds 00000100:00100000:2.0:1784404626.413781:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784404626.413798:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.413808:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728830976 00000100:00100000:2.0:1784404626.413812:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728830976 00000100:00100000:2.0:1784404626.413831:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728831360 00000100:00100000:2.0:1784404626.413834:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728831360 00000100:00100000:2.0:1784404626.413842:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728831488 00000100:00100000:2.0:1784404626.413844:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728831488 00000100:00100000:2.0:1784404626.413873:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784404626.413880:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:6513:x1871083728830976:12345-0@lo:104: 00010000:00010000:2.0:1784404626.413891:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.413928:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784404626.413933:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:6513:x1871083728830976:12345-0@lo:104: Request processed in 55us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.413939:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784404626.413953:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784404626.413958:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6513:x1871083728831360:12345-0@lo:104: 00010000:00010000:2.0:1784404626.413965:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414008:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784404626.414013:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6513:x1871083728831360:12345-0@lo:104: Request processed in 55us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.414030:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784404626.414059:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784404626.414064:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6513:x1871083728831488:12345-0@lo:104: 00010000:00010000:2.0:1784404626.414071:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414093:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784404626.414097:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6513:x1871083728831488:12345-0@lo:104: Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.414102:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1784404626.414117:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784404626.414121:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414127:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404626.414131:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414140:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404626.414147:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404626.414152:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404626.414178:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414184:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404626.414196:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414202:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541390000/0x24b3e2e6dcd78b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b58 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414214:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404626.414217:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414222:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404626.414225:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414230:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404626.414236:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404626.414240:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404626.414250:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414255:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404626.414267:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414281:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd540031000/0x24b3e2e6dcd78b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b19 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414292:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404626.414295:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414300:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404626.414303:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414312:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404626.414317:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404626.414321:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404626.414344:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414350:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404626.414355:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414361:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d209200/0x24b3e2e6dcd78ae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78aef expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414374:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.414380:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.414382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404626.414395:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404626.414542:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728831616:0@lo:103: 00000100:00100000:2.0:1784404626.414572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.414604:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728831616 00000100:00100000:2.0:1784404626.414608:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728831616 00010000:00010000:2.0:1784404626.414624:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.414644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784404626.414650:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3646:x1871083728831616:12345-0@lo:103: 00010000:00010000:2.0:1784404626.414659:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404626.414663:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414672:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.414684:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404626.414805:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821dae00/0x24b3e2e6dcd78be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bdd expref: 22 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.414818:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830208:0@lo:104: 00010000:00010000:1.0:1784404626.414830:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78bba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78bb3 expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.414847:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830336:0@lo:104: 00010000:00010000:1.0:1784404626.414875:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d209a00/0x24b3e2e6dcd78b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b90 expref: 20 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.414884:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830464:0@lo:104: 00010000:00010000:1.0:1784404626.414892:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b6d expref: 19 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.414902:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830848:0@lo:104: 00010000:00010000:1.0:1784404626.414910:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031800/0x24b3e2e6dcd78b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b51 expref: 18 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.414918:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728830976:0@lo:104: 00000100:00100000:1.0:1784404626.414926:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728831360:0@lo:104: 00000100:00100000:1.0:1784404626.414932:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1871083728831488:0@lo:104: 00010000:00010000:1.0:1784404626.414957:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.415117:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:3646:x1871083728831616:12345-0@lo:103: Request processed in 466us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.415125:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784404626.415151:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728831744:0@lo:103: 00000100:00100000:2.0:1784404626.415175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.415194:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404626.415199:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728831872:0@lo:103: 00000100:00100000:2.0:1784404626.415219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.415249:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728831744 00000100:00100000:2.0:1784404626.415259:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728831744 00010000:00010000:2.0:1784404626.415276:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 17 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.415290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728831872 00000100:00100000:2.0:1784404626.415292:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728831872 00010000:00010000:2.0:1784404626.415302:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 18 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.415313:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784404626.415318:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:3648:x1871083728831744:12345-0@lo:103: 00010000:00010000:2.0:1784404626.415325:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404626.415341:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.415350:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.415361:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390600/0x24b3e2e6dcd78b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b12 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.415371:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404626.415397:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:3648:x1871083728831744:12345-0@lo:103: Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.415511:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728831616:0@lo:103: 00000100:00100000:2.0:1784404626.415763:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784404626.415778:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784404626.415785:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:3648:x1871083728831872:12345-0@lo:103: 00010000:00010000:2.0:1784404626.415793:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404626.415798:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.415819:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.415830:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd78aef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ae8 expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.415842:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.415941:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.416431:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416451:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416459:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416466:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416473:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416480:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404626.416484:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416492:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416525:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.416536:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404626.416574:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3648:x1871083728831872:12345-0@lo:103: Request processed in 789us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.416581:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784404626.416615:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728831872:0@lo:103: 00000100:00100000:2.0:1784404626.416623:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728831744:0@lo:103: 00010000:00010000:1.0:1784404626.416789:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.416796:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.416803:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d208400/0x24b3e2e6dcd78bf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784404626.416825:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784404626.419820:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:9509:x1871083728830080:12345-0@lo:253: Request processed in 19920us (20265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.419832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784404626.420028:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728830080:0@lo:253: 10000000:01000000:3.0:1784404626.420043:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784404626.420046:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784404626.420048:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784404626.420049:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404626.420050:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1784404626.420052:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404626.420053:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404626.420054:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784404626.420056:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784404626.420057:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404626.420058:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784404626.420081:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd442280800 from lustre-OST0001 10000000:01000000:3.0:1784404626.420106:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784404626.420108:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784404626.420116:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd545b94d40 local copy 10000000:01000000:3.0:1784404626.420127:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784404626.420158:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.420168:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.420178:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404626.420195:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832000:0@lo:101: 00000100:00100000:3.0:1784404626.420225:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.420288:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54ace4840 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.420376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832000 00000100:00100000:0.0:1784404626.420382:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832000 00000100:00100000:0.0:1784404626.420527:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784404626.420536:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+14:9509:x1871083728832000:12345-0@lo:101: 00010000:00010000:0.0:1784404626.420548:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404626.420560:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd78c07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78c00 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.420580:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd78c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c00 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.420589:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd78c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c00 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.420598:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b600, rc 0) 00000100:00100000:0.0:1784404626.420635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832000:12345-0@lo:101: Request processed in 100us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.420640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784404626.420699:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832000:0@lo:101: 00010000:00010000:2.0:1784404626.420711:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.420719:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.420791:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832128:0@lo:501: 00000100:00100000:2.0:1784404626.420813:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.421006:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404626.421131:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832128 00000100:00100000:3.0:1784404626.421135:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832128 00000100:00100000:3.0:1784404626.421156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784404626.421162:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832128:12345-0@lo:501: 00000100:00100000:3.0:1784404626.421223:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832128:12345-0@lo:501: Request processed in 61us (408us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784404626.421229:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784404626.421306:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832128:0@lo:501: 10000000:01000000:2.0:1784404626.421316:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784404626.421343:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784404626.421348:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.421356:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.421372:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.421394:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784404626.421419:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd442280800 10000000:01000000:2.0:1784404626.421424:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784404626.421429:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784404626.421431:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784404626.421434:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1784404626.421437:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784404626.421450:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.421457:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.421464:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.421474:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832256:0@lo:101: 00000100:00100000:2.0:1784404626.421495:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.421506:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.421582:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832256 00000100:00100000:0.0:1784404626.421586:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832256 00000100:00100000:0.0:1784404626.421604:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784404626.421616:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832256:12345-0@lo:101: 00010000:00010000:0.0:1784404626.421623:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404626.421631:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78c0e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.421644:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.421653:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.421660:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a800, rc 0) 00000100:00100000:0.0:1784404626.421749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728832256:12345-0@lo:101: Request processed in 133us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.421754:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784404626.421811:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832256:0@lo:101: 00010000:00010000:2.0:1784404626.421820:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.421828:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.421905:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832384:0@lo:501: 00000100:00100000:2.0:1784404626.421926:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.421942:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.421990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832384 00000100:00100000:0.0:1784404626.421994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832384 00000100:00100000:0.0:1784404626.422009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784404626.422075:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728832384:12345-0@lo:501: 00000100:00100000:0.0:1784404626.422164:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728832384:12345-0@lo:501: Request processed in 150us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.422170:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:3.0:1784404626.422235:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404626.422241:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.422249:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821daa00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404626.422253:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.422261:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404626.422279:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404626.422285:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404626.422304:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.422309:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404626.422343:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.422351:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24b3e2e6dcd78c07 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.422364:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404626.422366:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404626.422367:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404626.422375:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404626.422386:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728832512:0@lo:103: 00000100:00100000:3.0:1784404626.422484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.422520:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832512 00000100:00100000:3.0:1784404626.422523:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832512 00000100:00100000:3.0:1784404626.422553:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784404626.422559:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:3647:x1871083728832512:12345-0@lo:103: 00010000:00010000:3.0:1784404626.422568:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404626.422580:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd78c07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c00 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.422591:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404626.422625:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3647:x1871083728832512:12345-0@lo:103: Request processed in 67us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404626.422631:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784404626.422658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728832512:0@lo:103: 00000100:00100000:2.0:1784404626.422784:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832384:0@lo:501: 00000100:00100000:2.0:1784404626.422809:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832640:0@lo:503: 00000100:00100000:2.0:1784404626.422876:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.422894:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404626.422985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832640 00000100:00100000:3.0:1784404626.422989:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832640 00000100:00100000:2.0:1784404626.423092:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784404626.423100:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832640:12345-0@lo:503: 00000100:00100000:2.0:1784404626.423190:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832640:12345-0@lo:503: Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.423196:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784404626.423265:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832640:0@lo:503: 00000040:00080000:0.0:1784404626.423601:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784404626.423671:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832768:0@lo:502: 00000100:00100000:0.0:1784404626.423776:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404626.423807:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404626.423843:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832768 00000100:00100000:3.0:1784404626.423879:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832768 00000100:00100000:3.0:1784404626.423901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784404626.423908:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832768:12345-0@lo:502: 00000100:00100000:3.0:1784404626.423991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832768:12345-0@lo:502: Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404626.423998:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784404626.424158:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832768:0@lo:502: 00000040:00080000:0.0:1784404626.424485:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784404626.424514:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784404626.424529:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784404626.424542:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784404626.424556:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784404626.424568:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784404626.424591:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832896:0@lo:502: 00000100:00100000:0.0:1784404626.424629:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404626.424657:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404626.424796:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728832896 00000100:00100000:2.0:1784404626.424801:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728832896 00000100:00100000:2.0:1784404626.424825:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784404626.424832:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832896:12345-0@lo:502: 00000100:00100000:2.0:1784404626.424927:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728832896:12345-0@lo:502: Request processed in 95us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.424934:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784404626.425143:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728832896:0@lo:502: 00000040:00080000:0.0:1784404626.425185:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784404626.425194:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1784404626.426314:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784404626.426322:0:9520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1784404626.426341:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404626.426344:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784404626.426351:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784404626.426370:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dd5704619c0) 00000020:00000080:3.0:1784404626.426395:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784404626.426474:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784404626.426560:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442280800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784404626.426568:0:9520:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784404626.426576:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b3e2e6dcd78c23 00010000:00010000:3.0:1784404626.434312:0:9520:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1784404626.434826:0:9520:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784404626.437810:0:9520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784404626.438520:0:9520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784404626.443792:0:9520:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1784404626.444190:0:9520:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1784404626.450670:0:9520:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1784404626.452796:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784404626.452809:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404626.452816:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404626.452824:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784404626.452829:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404626.452834:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404626.452835:0:9520:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784404626.452838:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784404626.452840:0:9520:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784404626.452889:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404626.452893:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404626.452894:0:9520:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784404626.452897:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784404626.455560:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1784404626.455608:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784404626.455677:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.455700:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404626.455709:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442280800 from 1 10000000:01000000:1.0:1784404626.455712:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404626.455753:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.455761:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.455771:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.455796:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833024:0@lo:101: 00000100:00100000:1.0:1784404626.455897:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.455952:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551e7f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.456142:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833024 00000100:00100000:0.0:1784404626.456150:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833024 00000100:00100000:0.0:1784404626.456199:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784404626.456209:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:9509:x1871083728833024:12345-0@lo:101: 00010000:00010000:0.0:1784404626.456225:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404626.456238:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78c2a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.456260:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.456270:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.456279:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ac00, rc 0) 00000100:00100000:0.0:1784404626.456319:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833024:12345-0@lo:101: Request processed in 111us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.456352:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784404626.456526:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833024:0@lo:101: 00010000:00010000:1.0:1784404626.456542:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.456558:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.456658:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833152:0@lo:501: 00000100:00100000:1.0:1784404626.456756:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.456790:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551e7f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.456843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833152 00000100:00100000:0.0:1784404626.456848:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833152 00000100:00100000:0.0:1784404626.456901:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784404626.456909:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833152:12345-0@lo:501: 00000100:00100000:0.0:1784404626.457005:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833152:12345-0@lo:501: Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.457012:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784404626.457160:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833152:0@lo:501: 00000100:00100000:1.0:1784404626.457189:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833280:0@lo:503: 00000100:00100000:1.0:1784404626.457231:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.457260:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551e7f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.457307:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833280 00000100:00100000:0.0:1784404626.457312:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833280 00000100:00100000:0.0:1784404626.457349:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784404626.457357:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833280:12345-0@lo:503: 00000100:00100000:0.0:1784404626.457948:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833280:12345-0@lo:503: Request processed in 590us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.457956:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784404626.458148:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833280:0@lo:503: 00000040:00080000:1.0:1784404626.458395:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784404626.458910:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833408:0@lo:502: 00000100:00100000:1.0:1784404626.458958:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.458988:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.459584:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833408 00000100:00100000:0.0:1784404626.459591:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833408 00000100:00100000:0.0:1784404626.459626:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784404626.459635:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833408:12345-0@lo:502: 00000100:00100000:0.0:1784404626.460001:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833408:12345-0@lo:502: Request processed in 366us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.460008:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784404626.460114:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833408:0@lo:502: 00000040:00080000:1.0:1784404626.460305:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784404626.460345:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784404626.460369:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833536:0@lo:502: 00000100:00100000:1.0:1784404626.460797:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.460878:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833536 00000100:00100000:3.0:1784404626.460895:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833536 00000100:00100000:3.0:1784404626.460938:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784404626.460946:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833536:12345-0@lo:502: 00000100:00100000:1.0:1784404626.464908:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f480 going to sleep for 11 seconds 00000100:00100000:3.0:1784404626.466350:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833536:12345-0@lo:502: Request processed in 5398us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404626.466364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784404626.466777:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833536:0@lo:502: 00000040:00080000:1.0:1784404626.467053:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784404626.467067:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784404626.467761:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404626.467771:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404626.467774:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784404626.467780:0:9524:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd442280800 00000020:00000080:1.0:1784404626.467783:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784404626.467795:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404626.467799:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404626.467800:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784404626.467802:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1784404626.468193:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784404626.468215:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404626.468235:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.468247:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404626.468298:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784404626.468301:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd442280800 10000000:01000000:3.0:1784404626.468304:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd442280800 10000000:01000000:3.0:1784404626.468309:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784404626.468314:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd442280800 from 1 10000000:01000000:3.0:1784404626.468317:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784404626.468366:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.468374:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.468384:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404626.468507:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833664:0@lo:101: 00000100:00100000:3.0:1784404626.468567:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.468645:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5817a89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404626.468829:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833664 00000100:00100000:0.0:1784404626.468837:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833664 00000100:00100000:0.0:1784404626.469105:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784404626.469116:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9509:x1871083728833664:12345-0@lo:101: 00010000:00010000:0.0:1784404626.469140:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404626.469153:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78c38 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.469176:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.469186:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404626.469195:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151aa00, rc 0) 00000100:00100000:0.0:1784404626.469244:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728833664:12345-0@lo:101: Request processed in 130us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.469251:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784404626.469323:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833664:0@lo:101: 00010000:00010000:3.0:1784404626.469347:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404626.469356:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404626.469476:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833792:0@lo:501: 00000100:00100000:3.0:1784404626.469502:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.469650:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5817a89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404626.469782:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833792 00000100:00100000:1.0:1784404626.469789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833792 00000100:00100000:1.0:1784404626.469816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784404626.469823:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728833792:12345-0@lo:501: 00000100:00100000:1.0:1784404626.469955:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728833792:12345-0@lo:501: Request processed in 131us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.469963:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784404626.470162:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833792:0@lo:501: 00000100:00100000:3.0:1784404626.470207:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833920:0@lo:503: 00000100:00100000:3.0:1784404626.470246:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.470277:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5817a89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404626.470323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728833920 00000100:00100000:1.0:1784404626.470337:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728833920 00000100:00100000:1.0:1784404626.470369:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784404626.470376:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728833920:12345-0@lo:503: 00000100:00100000:1.0:1784404626.470475:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728833920:12345-0@lo:503: Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.470482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784404626.470615:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728833920:0@lo:503: 00000040:00080000:3.0:1784404626.470889:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784404626.470961:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728834048:0@lo:502: 00000100:00100000:3.0:1784404626.470996:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.471014:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd55268ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404626.471193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834048 00000100:00100000:1.0:1784404626.471198:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834048 00000100:00100000:1.0:1784404626.471218:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784404626.471224:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728834048:12345-0@lo:502: 00000100:00100000:1.0:1784404626.471313:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728834048:12345-0@lo:502: Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.471338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784404626.471536:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728834048:0@lo:502: 00000040:00080000:3.0:1784404626.471832:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784404626.471908:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784404626.471936:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784404626.471953:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784404626.471967:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784404626.471981:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784404626.472005:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784404626.472132:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784404626.472150:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784404626.472163:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784404626.472173:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784404626.472184:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784404626.472195:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784404626.472206:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784404626.472217:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784404626.472228:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784404626.472241:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784404626.472254:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784404626.472279:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784404626.472295:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784404626.472310:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784404626.472325:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784404626.472353:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784404626.472368:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784404626.472380:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1784404626.472392:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1784404626.472550:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1784404626.472570:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1784404626.472585:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1784404626.472601:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1784404626.472614:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1784404626.472626:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1784404626.472640:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1784404626.472654:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1784404626.472681:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1784404626.472775:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1784404626.472791:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1784404626.472807:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1784404626.472817:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1784404626.472842:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1784404626.472978:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1784404626.472996:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1784404626.473008:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1784404626.473096:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1784404626.473114:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1784404626.473127:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1784404626.473164:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728834176:0@lo:502: 00000100:00100000:3.0:1784404626.473228:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.473304:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5817a89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404626.473619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834176 00000100:00100000:2.0:1784404626.473626:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834176 00000100:00100000:1.0:1784404626.473875:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784404626.473889:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728834176:12345-0@lo:502: 00000100:00100000:1.0:1784404626.474128:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728834176:12345-0@lo:502: Request processed in 132us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.474136:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784404626.474242:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728834176:0@lo:502: 00000040:00080000:3.0:1784404626.474300:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1784404626.474310:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1784404626.475134:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784404626.475150:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dd44213b380) 00000020:00000080:1.0:1784404626.475174:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1784404626.475398:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442280800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784404626.475480:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd442280800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784404626.475483:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442280800 3 00010000:00080000:1.0:1784404626.475514:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd44319c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784404626.484799:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1784404626.484928:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784404626.484975:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784404626.484989:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x24b3e2e6dcd78c4d 00000100:00080000:1.0:1784404626.484998:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784404626.485005:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404626.486268:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574ea0380 x1871083728834304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404626.486303:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784404626.486449:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728834432:0@lo:400: 00000100:00100000:1.0:1784404626.486517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.486551:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728834944:0@lo:400: 00000100:00100000:1.0:1784404626.486575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.486610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784404626.486616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728834816:0@lo:400: 00000100:00100000:1.0:1784404626.486642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.486661:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728835328:0@lo:400: 00000100:00100000:1.0:1784404626.486816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.486883:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834432 00000100:00100000:1.0:1784404626.486891:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834432 00000100:00100000:1.0:1784404626.486932:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834944 00000100:00100000:1.0:1784404626.486935:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834944 00000100:00100000:1.0:1784404626.486964:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784404626.486973:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728834432:12345-0@lo:400: 00000100:00100000:1.0:1784404626.487117:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728834432:12345-0@lo:400: Request processed in 144us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.487125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784404626.487142:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404626.487148:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728834944:12345-0@lo:400: 00000100:00100000:1.0:1784404626.487174:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728834944:12345-0@lo:400: Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.487180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404626.487201:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834816 00000100:00100000:1.0:1784404626.487205:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834816 00000100:00100000:1.0:1784404626.487231:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404626.487237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728834816:12345-0@lo:400: 00000100:00100000:1.0:1784404626.487267:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728834816:12345-0@lo:400: Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.487272:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404626.487291:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835328 00000100:00100000:1.0:1784404626.487295:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835328 00000100:00100000:1.0:1784404626.487340:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404626.487347:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728835328:12345-0@lo:400: 00000100:00100000:1.0:1784404626.487377:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728835328:12345-0@lo:400: Request processed in 31us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.487383:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404626.487566:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728834304:0@lo:38: 00000100:00100000:0.0:1784404626.487603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.489533:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728834560:0@lo:400: 00000100:00100000:2.0:1784404626.489596:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.489635:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728835072:0@lo:400: 00000100:00100000:2.0:1784404626.489665:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728834688:0@lo:400: 00000100:00100000:2.0:1784404626.489706:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834560 00000100:00100000:2.0:1784404626.489712:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834560 00000100:00100000:2.0:1784404626.489748:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784404626.489756:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728834560:12345-0@lo:400: 00000100:00100000:2.0:1784404626.489804:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728834560:12345-0@lo:400: Request processed in 48us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.489810:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784404626.492806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.492897:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728834560:0@lo:400: 00000100:00100000:2.0:1784404626.492932:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.492954:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728835200:0@lo:400: 00000100:00100000:2.0:1784404626.493004:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404626.493128:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834304 00000100:00100000:0.0:1784404626.493136:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834304 00000100:00100000:0.0:1784404626.493163:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835072 00000100:00100000:0.0:1784404626.493166:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835072 00000100:00100000:0.0:1784404626.493189:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728834688 00000100:00100000:0.0:1784404626.493192:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728834688 00000100:00100000:0.0:1784404626.493208:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784404626.493217:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728835072:12345-0@lo:400: 00000100:00100000:1.0:1784404626.493360:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784404626.493369:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1784404626.493387:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404626.493392:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404626.493395:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404626.493422:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835200 00000100:00100000:1.0:1784404626.493426:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835200 00000100:00100000:1.0:1784404626.493460:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404626.493467:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728835200:12345-0@lo:400: 00000100:00100000:0.0:1784404626.494535:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728835072:12345-0@lo:400: Request processed in 1315us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.494546:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784404626.494570:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784404626.494579:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728834688:12345-0@lo:400: 00000100:00100000:0.0:1784404626.494629:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728834688:12345-0@lo:400: Request processed in 52us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.494636:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784404626.494649:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784404626.494654:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728834304:12345-0@lo:38: 00010000:00080000:0.0:1784404626.494677:0:6519:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1784404626.494723:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x24b3e2e6dcd78c54 00000004:00100000:0.0:1784404626.494739:0:6519:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784404626.494767:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9dd442733800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404626.495129:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1871083728834304:12345-0@lo:38: Request processed in 473us (7525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.495136:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784404626.495177:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574ea0380 x1871083728834304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404626.495189:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784404626.495197:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784404626.495203:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784404626.495208:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784404626.495210:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784404626.495216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728834304:0@lo:38: 00010000:00080000:2.0:1784404626.495303:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574ea3480 x1871083728834688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404626.495320:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728834688:0@lo:400: 00000100:00100000:0.0:1784404626.495938:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728834816:0@lo:400: 00010000:00080000:0.0:1784404626.495952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574ea2a00 x1871083728835328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404626.495962:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728835328:0@lo:400: 00010000:00080000:0.0:1784404626.495992:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574ea0000 x1871083728834432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404626.495999:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728834432:0@lo:400: 00010000:00080000:0.0:1784404626.496008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574ea1880 x1871083728834944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404626.496086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728834944:0@lo:400: 00010000:00080000:3.0:1784404626.496530:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574ea2300 x1871083728835072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404626.496542:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728835072:0@lo:400: 00000020:01000004:2.0:1784404626.496740:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784404626.496755:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dd573b1cd40) 00000020:00000080:2.0:1784404626.496777:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:1.0:1784404626.498902:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728835200:12345-0@lo:400: Request processed in 5428us (5889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.498917:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784404626.499001:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574ea1180 x1871083728835200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404626.499027:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728835200:0@lo:400: 00000100:00080000:1.0:1784404626.499067:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1784404626.499846:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442280800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784404626.499879:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd442280800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784404626.499882:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442280800 3 00010000:00080000:2.0:1784404626.499916:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd44333a800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.142@tcp at head 00000100:00100000:3.0:1784404626.500378:0:9528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9528:1871083728835456:0@lo:901: 00000100:00100000:3.0:1784404626.500457:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404626.500487:0:9528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e779c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784404626.506074:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1784404626.506188:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1784404626.506234:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784404626.506249:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x24b3e2e6dcd78c62 00000100:00080000:2.0:1784404626.506261:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404626.506267:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd44333a800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404626.506305:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd57c92a300 x1871083728835584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404626.506341:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784404626.506557:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083728835584:0@lo:38: 00000100:00100000:0.0:1784404626.506632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404626.506705:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835584 00000100:00100000:0.0:1784404626.506713:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835584 00000100:00100000:0.0:1784404626.506744:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404626.506751:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728835584:12345-0@lo:38: 00010000:00080000:0.0:1784404626.506777:0:6519:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1784404626.506812:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x24b3e2e6dcd78c69 00000004:00100000:0.0:1784404626.506826:0:6519:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784404626.506883:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9dd442735000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404626.506934:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1871083728835584:12345-0@lo:38: Request processed in 182us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404626.506942:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784404626.506979:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd57c92a300 x1871083728835584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404626.506989:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784404626.506995:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784404626.507002:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784404626.507005:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784404626.507128:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44333a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784404626.507134:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083728835584:0@lo:38: 00000100:00100000:1.0:1784404626.507380:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835456 00000100:00100000:1.0:1784404626.507385:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835456 00000100:00100000:1.0:1784404626.507456:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404626.507464:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1871083728835456:12345-0@lo:901: 00000100:00100000:1.0:1784404626.507556:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1871083728835456:12345-0@lo:901: Request processed in 94us (7100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404626.507564:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784404626.507647:0:9528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd565e14380 x1871083728835456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784404642 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404626.507659:0:9528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e14380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9528:1871083728835456:0@lo:901: 00000100:00080000:0.0:1784404626.507826:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1784404626.508276:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1784404626.508503:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1784404626.508529:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404626.508550:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.508560:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784404626.508608:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784404626.508610:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784404626.508612:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404626.508613:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404626.508614:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404626.508615:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404626.508617:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404626.508618:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784404626.508620:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784404626.508622:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404626.508623:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404626.508627:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1784404626.508629:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784404626.508631:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784404626.508632:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404626.508633:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404626.508634:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404626.508636:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404626.508637:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404626.508638:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784404626.508639:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784404626.508640:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404626.508641:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404626.508658:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784404626.508679:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728835712:0@lo:253: 00000100:00100000:1.0:1784404626.508739:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.508779:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551e7f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404626.508899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835712 00000100:00100000:2.0:1784404626.508904:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835712 00000100:00100000:2.0:1784404626.508940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784404626.508948:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728835712:12345-0@lo:253: 20000000:01000000:2.0:1784404626.508971:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784404626.508985:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784404626.513159:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784404626.513179:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784404626.513495:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9509:x1871083728835712:12345-0@lo:253: Request processed in 4544us (4752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.513517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784404626.513696:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9509:1871083728835712:0@lo:253: 10000000:01000000:0.0:1784404626.513713:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784404626.513716:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784404626.513718:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784404626.513720:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784404626.513721:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784404626.513722:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784404626.513723:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784404626.513725:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784404626.513727:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784404626.513728:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784404626.513730:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784404626.513731:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784404626.513746:0:9509:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1784404626.516814:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784404626.516826:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784404626.516884:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.516905:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.516914:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.516921:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.516968:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.516985:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.517002:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728835840:0@lo:104: 00000100:00100000:1.0:1784404626.517532:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404626.517597:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.517606:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 16 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.517633:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728835968:0@lo:104: 00000100:00100000:1.0:1784404626.517658:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404626.517682:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551c6f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784404626.517778:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835840 00000100:00100000:2.0:1784404626.517785:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835840 00000100:00100000:2.0:1784404626.517824:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728835968 00000100:00100000:2.0:1784404626.517827:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728835968 00000100:00100000:2.0:1784404626.517841:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784404626.517868:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6535:x1871083728835840:12345-0@lo:104: 00010000:00010000:2.0:1784404626.517881:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.517934:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784404626.517940:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:6535:x1871083728835840:12345-0@lo:104: Request processed in 91us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.517946:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784404626.517963:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784404626.517968:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728835968:12345-0@lo:104: 00010000:00010000:2.0:1784404626.517975:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518005:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784404626.518010:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:6535:x1871083728835968:12345-0@lo:104: Request processed in 43us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.518029:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1784404626.518048:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404626.518053:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518061:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dbc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404626.518072:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518081:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404626.518088:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404626.518105:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404626.518134:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518140:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404626.518156:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518163:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78bac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518178:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404626.518181:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518187:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404626.518189:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518195:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404626.518210:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404626.518215:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404626.518228:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518233:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404626.518247:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518252:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd78b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b66 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518268:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.518269:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.518271:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404626.518277:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404626.518288:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728836096:0@lo:103: 00000100:00100000:2.0:1784404626.518315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.518361:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728836224:0@lo:103: 00000100:00100000:2.0:1784404626.518381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404626.518781:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836096 00000100:00100000:2.0:1784404626.518787:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836096 00010000:00010000:2.0:1784404626.518813:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 17 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.518836:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836224 00000100:00100000:2.0:1784404626.518839:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836224 00010000:00010000:2.0:1784404626.518883:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404626.518897:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784404626.518904:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:3647:x1871083728836096:12345-0@lo:103: 00010000:00010000:2.0:1784404626.518916:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404626.518921:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 18 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518931:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 18 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.518950:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404626.518984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:3647:x1871083728836096:12345-0@lo:103: Request processed in 80us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.518991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784404626.519006:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784404626.519011:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:3648:x1871083728836224:12345-0@lo:103: 00010000:00010000:2.0:1784404626.519021:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404626.519026:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 17 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519035:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 17 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519047:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519057:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784404626.519085:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008450886s 00010000:00010000:2.0:1784404626.519091:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519098:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519105:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519111:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519117:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208a00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404626.519121:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519129:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519138:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404626.519148:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404626.519176:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:3648:x1871083728836224:12345-0@lo:103: Request processed in 165us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404626.519182:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784404626.519231:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728836224:0@lo:103: 00000100:00100000:2.0:1784404626.519257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728836096:0@lo:103: 00010000:00010000:1.0:1784404626.519360:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ba5 expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.519375:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728835840:0@lo:104: 00010000:00010000:1.0:1784404626.519385:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd78b66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b5f expref: 15 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404626.519395:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1871083728835968:0@lo:104: 00010000:00010000:1.0:1784404626.519496:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.519506:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.519513:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404626.519519:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd78c70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1784404626.524420:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1784404626.524567:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784404626.525029:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1784404626.525226:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784404626.525466:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784404626.525667:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1784404626.528220:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784404626.540962:0:9509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784404626.540973:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784404626.541010:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784404626.541161:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784404626.541181:0:9509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1784404626.541206:0:9509:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1784404626.542168:0:9509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404626.542376:0:9509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1784404626.692536:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784404627.365263:0:9582:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404627.365639:0:9582:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784404627.715430:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404628.362302:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728836480:0@lo:13: 00000100:00100000:3.0:1784404628.362391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404628.362467:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836480 00000100:00100000:3.0:1784404628.362474:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836480 00000100:00100000:3.0:1784404628.362522:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404628.362531:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728836480:12345-0@lo:13: 00002000:00000024:3.0:1784404628.362559:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404628.362600:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728836480:12345-0@lo:13: Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404628.362614:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1784404628.362634:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404628.362662:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e16300 x1871083728836480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404628.362680:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728836480:0@lo:13: 00000100:00100000:3.0:1784404628.362975:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404628.362988:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728836352:0@lo:13: 00000100:00100000:3.0:1784404628.363033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404628.363061:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836352 00000100:00100000:3.0:1784404628.363065:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836352 00000100:00100000:3.0:1784404628.363296:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404628.363303:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728836352:12345-0@lo:13: 00002000:00000024:3.0:1784404628.363326:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404628.363360:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728836352:12345-0@lo:13: Request processed in 58us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404628.363367:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1784404628.363383:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404628.363403:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea1f80 x1871083728836352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404628.363418:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728836352:0@lo:13: 00010000:00010000:0.0:1784404628.742445:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404629.763021:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404629.893399:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404629.893430:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728836608:0@lo:41: 00000100:00100000:3.0:1784404629.893518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404629.893633:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836608 00000100:00100000:1.0:1784404629.893642:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836608 00000100:00100000:1.0:1784404629.893697:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784404629.893708:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728836608:12345-0@lo:41: 00000004:00000024:1.0:1784404629.893740:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784404629.893808:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728836608:12345-0@lo:41: Request processed in 101us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404629.893816:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784404629.894544:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728836608:0@lo:41: 00010000:00010000:0.0:1784404630.787449:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404630.930706:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404630.930732:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728836736:0@lo:41: 00000100:00100000:2.0:1784404630.930805:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404630.930912:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836736 00000100:00100000:2.0:1784404630.930920:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836736 00000100:00100000:2.0:1784404630.930970:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784404630.930980:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728836736:12345-0@lo:41: 00000004:00000024:2.0:1784404630.931015:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1784404630.931065:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728836736:12345-0@lo:41: Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404630.931072:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784404630.931122:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728836736:0@lo:41: 00010000:00010000:2.0:1784404631.813863:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404631.945665:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728837248:0@lo:400: 00000100:00100000:3.0:1784404631.945824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.945908:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728837760:0@lo:400: 00000100:00100000:3.0:1784404631.945948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.945984:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784404631.945990:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728836864:0@lo:400: 00000100:00100000:3.0:1784404631.946019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.946037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728837376:0@lo:400: 00000100:00100000:3.0:1784404631.946070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.946088:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728837888:0@lo:400: 00000100:00100000:3.0:1784404631.946644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.946683:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728836992:0@lo:400: 00000100:00100000:3.0:1784404631.947143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.947164:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728837504:0@lo:400: 00000100:00100000:3.0:1784404631.947190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.947209:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728838016:0@lo:400: 00000100:00100000:3.0:1784404631.947228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.947250:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784404631.947257:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728837120:0@lo:400: 00000100:00100000:3.0:1784404631.947297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.947317:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728837632:0@lo:400: 00000100:00100000:3.0:1784404631.947354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.948144:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728838144:0@lo:400: 00000100:00100000:3.0:1784404631.948176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404631.948215:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728837248 00000100:00100000:3.0:1784404631.948223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728837248 00000100:00100000:3.0:1784404631.948275:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836992 00000100:00100000:3.0:1784404631.948290:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836992 00000100:00100000:3.0:1784404631.948306:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728837504 00000100:00100000:3.0:1784404631.948308:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728837504 00000100:00100000:3.0:1784404631.948332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838016 00000100:00100000:3.0:1784404631.948334:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838016 00000100:00100000:3.0:1784404631.948348:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728837632 00000100:00100000:3.0:1784404631.948351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728837632 00000100:00100000:3.0:1784404631.948378:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838144 00000100:00100000:3.0:1784404631.948381:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838144 00000100:00100000:3.0:1784404631.948397:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784404631.948404:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728837248:12345-0@lo:400: 00000100:00100000:3.0:1784404631.948472:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728837248:12345-0@lo:400: Request processed in 67us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.948479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784404631.948498:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784404631.948573:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728836992:12345-0@lo:400: 00000100:00100000:3.0:1784404631.948615:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728836992:12345-0@lo:400: Request processed in 110us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.948621:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784404631.948635:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784404631.948642:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728837504:12345-0@lo:400: 00000100:00100000:3.0:1784404631.948671:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728837504:12345-0@lo:400: Request processed in 30us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.948677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784404631.948690:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784404631.948696:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728838016:12345-0@lo:400: 00000100:00100000:3.0:1784404631.948738:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728838016:12345-0@lo:400: Request processed in 42us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.948750:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784404631.948763:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784404631.948770:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728837632:12345-0@lo:400: 00000100:00100000:3.0:1784404631.948813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728837632:12345-0@lo:400: Request processed in 45us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.948818:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784404631.948832:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784404631.949156:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728838144:12345-0@lo:400: 00000100:00100000:3.0:1784404631.949199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728838144:12345-0@lo:400: Request processed in 47us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.949205:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784404631.949239:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728837760 00000100:00100000:3.0:1784404631.949243:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728837760 00000100:00100000:3.0:1784404631.949291:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728837888 00000100:00100000:3.0:1784404631.949295:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728837888 00000100:00100000:3.0:1784404631.949319:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404631.949326:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728837760:12345-0@lo:400: 00000100:00100000:3.0:1784404631.949377:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728837760:12345-0@lo:400: Request processed in 50us (3427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.949383:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404631.949396:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784404631.949403:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728837888:12345-0@lo:400: 00000100:00100000:3.0:1784404631.949435:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728837888:12345-0@lo:400: Request processed in 32us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404631.949441:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784404631.949461:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728837376 00000100:00100000:3.0:1784404631.949471:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728837376 00000100:00100000:3.0:1784404631.949491:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728837120 00000100:00100000:3.0:1784404631.949495:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728837120 00000100:00100000:0.0:1784404631.950992:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728836864 00000100:00100000:0.0:1784404631.951002:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728836864 00000100:00100000:0.0:1784404631.951120:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784404631.951129:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3648:x1871083728836864:12345-0@lo:400: 00000100:00100000:0.0:1784404631.951210:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:3648:x1871083728836864:12345-0@lo:400: Request processed in 83us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404631.951221:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1784404631.951343:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404631.951467:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404631.951472:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404631.951488:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784404631.951498:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728837376:12345-0@lo:400: 00000100:00100000:0.0:1784404631.951705:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728837376:12345-0@lo:400: Request processed in 209us (5634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404631.951723:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784404631.951740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404631.951747:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728837120:12345-0@lo:400: 00000100:00100000:0.0:1784404631.951782:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728837120:12345-0@lo:400: Request processed in 35us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404631.952610:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404631.953274:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728837120:0@lo:400: 00010000:00080000:0.0:1784404631.953306:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442554000 x1871083728837632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.953317:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728837632:0@lo:400: 00010000:00080000:0.0:1784404631.953342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e70700 x1871083728838144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.953351:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728838144:0@lo:400: 00010000:00080000:0.0:1784404631.953363:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9ad80 x1871083728836992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.953371:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728836992:0@lo:400: 00010000:00080000:0.0:1784404631.953381:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442554700 x1871083728837504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.953389:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728837504:0@lo:400: 00010000:00080000:0.0:1784404631.953400:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e70e00 x1871083728838016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.953408:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728838016:0@lo:400: 00000100:00100000:0.0:1784404631.953451:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728836864:0@lo:400: 00000100:00100000:0.0:1784404631.953461:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728837376:0@lo:400: 00010000:00080000:0.0:1784404631.953471:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442555880 x1871083728837888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.953478:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728837888:0@lo:400: 00010000:00080000:0.0:1784404631.953489:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442554e00 x1871083728837248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.953498:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728837248:0@lo:400: 00010000:00080000:0.0:1784404631.954611:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442555c00 x1871083728837760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404631.954635:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728837760:0@lo:400: 00010000:00010000:2.0:1784404632.835787:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784404632.865227:0:9872:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1784404633.474939:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784404633.474948:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd574d3a800 from 39 10000000:01000000:2.0:1784404633.474953:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784404633.474999:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.475011:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.475022:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404633.475056:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728838272:0@lo:101: 00000100:00100000:2.0:1784404633.475127:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.475177:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.475293:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838272 00000100:00100000:1.0:1784404633.475303:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838272 00000100:00100000:1.0:1784404633.475353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784404633.475362:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728838272:12345-0@lo:101: 00010000:00010000:1.0:1784404633.475375:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404633.475387:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78c77 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.475413:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.475424:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.475434:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d208200, rc 0) 00000100:00100000:1.0:1784404633.475481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728838272:12345-0@lo:101: Request processed in 120us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.475488:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784404633.475550:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728838272:0@lo:101: 00010000:00010000:1.0:1784404633.475565:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.475574:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.475637:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728838400:0@lo:501: 00000100:00100000:1.0:1784404633.475666:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.475678:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.478444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838400 00000100:00100000:0.0:1784404633.478463:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838400 00000100:00100000:0.0:1784404633.478541:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784404633.478552:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728838400:12345-0@lo:501: 00000100:00100000:0.0:1784404633.478760:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728838400:12345-0@lo:501: Request processed in 209us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.478774:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784404633.478971:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728838400:0@lo:501: 00000100:00100000:1.0:1784404633.479029:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728838528:0@lo:503: 00000100:00100000:1.0:1784404633.479085:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.479120:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c0f480 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.479135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838528 00000100:00100000:1.0:1784404633.479138:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838528 00000100:00100000:1.0:1784404633.479163:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784404633.479169:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728838528:12345-0@lo:503: 00000100:00100000:1.0:1784404633.479250:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728838528:12345-0@lo:503: Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.479257:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784404633.479508:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728838528:0@lo:503: 00000100:00100000:1.0:1784404633.479749:0:9899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9899:1871083728838656:0@lo:502: 00000100:00100000:1.0:1784404633.479782:0:9899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.479794:0:9899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404633.479878:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838656 00000100:00100000:2.0:1784404633.479883:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838656 00000100:00100000:2.0:1784404633.479915:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784404633.479922:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9899:x1871083728838656:12345-0@lo:502: 00000100:00100000:2.0:1784404633.480018:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9899:x1871083728838656:12345-0@lo:502: Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404633.480024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784404633.480931:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404633.480946:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728838784:0@lo:13: 00000100:00100000:3.0:1784404633.481012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.481051:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838784 00000100:00100000:3.0:1784404633.481055:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838784 00000100:00100000:3.0:1784404633.481097:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784404633.481105:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728838784:12345-0@lo:13: 00002000:00000024:3.0:1784404633.481130:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404633.481173:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728838784:12345-0@lo:13: Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.481180:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1784404633.481200:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404633.481230:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b2a00 x1871083728838784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404633.481248:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728838784:0@lo:13: 00000100:00100000:1.0:1784404633.481839:0:9899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9899:1871083728838656:0@lo:502: 00000100:00100000:1.0:1784404633.481923:0:9899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9899:1871083728839040:0@lo:502: 00000100:00100000:1.0:1784404633.481970:0:9899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.481995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839040 00000100:00100000:1.0:1784404633.482000:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839040 00000100:00100000:1.0:1784404633.482039:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784404633.482045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9899:x1871083728839040:12345-0@lo:502: 00000100:00100000:1.0:1784404633.482149:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:9899:x1871083728839040:12345-0@lo:502: Request processed in 104us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.482160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784404633.482203:0:9899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.482215:0:9899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9899:1871083728839040:0@lo:502: 00000040:00080000:1.0:1784404633.482232:0:9899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1784404633.482305:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1784404633.482326:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404633.482334:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.482345:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404633.482355:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784404633.482358:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1784404633.482361:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784404633.482383:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.482391:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.482401:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.482412:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839168:0@lo:101: 00000100:00100000:1.0:1784404633.482438:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.482453:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.486606:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728838912:0@lo:13: 00000100:00100000:3.0:1784404633.486706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.486789:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728838912 00000100:00100000:3.0:1784404633.486798:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728838912 00000100:00100000:3.0:1784404633.486872:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404633.486881:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728838912:12345-0@lo:13: 00002000:00000024:3.0:1784404633.486910:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404633.486957:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728838912:12345-0@lo:13: Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.486973:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1784404633.487000:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404633.487029:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929f80 x1871083728838912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404633.487051:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728838912:0@lo:13: 00000100:00100000:1.0:1784404633.487160:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839168 00000100:00100000:1.0:1784404633.487180:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839168 00000100:00100000:1.0:1784404633.487236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784404633.487243:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728839168:12345-0@lo:101: 00010000:00010000:1.0:1784404633.487256:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404633.487285:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78c85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.487312:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.487325:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.487335:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209000, rc 0) 00000100:00100000:1.0:1784404633.487375:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728839168:12345-0@lo:101: Request processed in 133us (4936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.487381:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784404633.487419:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839168:0@lo:101: 00010000:00010000:1.0:1784404633.487436:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.487446:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.487516:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839296:0@lo:501: 00000100:00100000:1.0:1784404633.487544:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.487567:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.487580:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839296 00000100:00100000:1.0:1784404633.487583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839296 00000100:00100000:1.0:1784404633.487605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784404633.487618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728839296:12345-0@lo:501: 00000100:00100000:1.0:1784404633.487735:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728839296:12345-0@lo:501: Request processed in 117us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.487742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784404633.487769:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839296:0@lo:501: 00000100:00100000:1.0:1784404633.487791:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839424:0@lo:503: 00000100:00100000:1.0:1784404633.487823:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.487835:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.487843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839424 00000100:00100000:1.0:1784404633.487846:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839424 00000100:00100000:1.0:1784404633.487887:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784404633.487892:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728839424:12345-0@lo:503: 00000100:00100000:1.0:1784404633.487965:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728839424:12345-0@lo:503: Request processed in 72us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.487972:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784404633.488011:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839424:0@lo:503: 00000100:00100000:0.0:1784404633.489257:0:9901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9901:1871083728839552:0@lo:502: 00000100:00100000:0.0:1784404633.489336:0:9901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404633.489376:0:9901:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.489570:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839552 00000100:00100000:1.0:1784404633.489578:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839552 00000100:00100000:1.0:1784404633.489624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784404633.489632:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9901:x1871083728839552:12345-0@lo:502: 00000100:00100000:1.0:1784404633.489751:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9901:x1871083728839552:12345-0@lo:502: Request processed in 119us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.489758:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784404633.490410:0:9901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9901:1871083728839552:0@lo:502: 00000020:01000000:0.0:1784404633.490442:0:9901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404633.490454:0:9901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404633.490456:0:9901:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784404633.490462:0:9901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784404633.490464:0:9901:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784404633.490485:0:9901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9901:1871083728839680:0@lo:502: 00000100:00100000:0.0:1784404633.490522:0:9901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404633.490553:0:9901:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.490594:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839680 00000100:00100000:3.0:1784404633.490601:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839680 00000100:00100000:3.0:1784404633.490634:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784404633.490641:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9901:x1871083728839680:12345-0@lo:502: 00000100:00100000:3.0:1784404633.490734:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:9901:x1871083728839680:12345-0@lo:502: Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.490741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784404633.490807:0:9901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9901:1871083728839680:0@lo:502: 00000020:01000000:0.0:1784404633.490824:0:9901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404633.490829:0:9901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404633.490831:0:9901:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784404633.490834:0:9901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1784404633.491036:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1784404633.491058:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784404633.491068:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.491079:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404633.491089:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784404633.491091:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd565e88000 from 39 10000000:01000000:3.0:1784404633.491094:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784404633.491120:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.491128:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.491152:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404633.491391:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839808:0@lo:101: 00000100:00100000:3.0:1784404633.491426:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.491456:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aedb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.492187:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839808 00000100:00100000:0.0:1784404633.492203:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839808 00000100:00100000:0.0:1784404633.492284:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784404633.492293:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728839808:12345-0@lo:101: 00010000:00010000:0.0:1784404633.492305:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404633.492320:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78c93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.492347:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.492357:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.492366:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b800, rc 0) 00000100:00100000:0.0:1784404633.492426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728839808:12345-0@lo:101: Request processed in 134us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.492432:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784404633.494895:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839808:0@lo:101: 00010000:00010000:2.0:1784404633.494918:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.494929:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404633.495005:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839936:0@lo:501: 00000100:00100000:2.0:1784404633.495051:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.495084:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b780 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.495238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728839936 00000100:00100000:3.0:1784404633.495244:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728839936 00000100:00100000:3.0:1784404633.495305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784404633.495315:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728839936:12345-0@lo:501: 00000100:00100000:3.0:1784404633.495464:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728839936:12345-0@lo:501: Request processed in 151us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.495469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784404633.495541:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728839936:0@lo:501: 00000100:00100000:2.0:1784404633.495562:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840064:0@lo:503: 00000100:00100000:2.0:1784404633.495593:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.495607:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b780 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.495635:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840064 00000100:00100000:3.0:1784404633.495638:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840064 00000100:00100000:3.0:1784404633.495685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784404633.495692:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728840064:12345-0@lo:503: 00000100:00100000:3.0:1784404633.495768:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728840064:12345-0@lo:503: Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.495772:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784404633.495824:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840064:0@lo:503: 00000100:00100000:1.0:1784404633.503545:0:9904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9904:1871083728840192:0@lo:502: 00000100:00100000:1.0:1784404633.503616:0:9904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.503650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840192 00000100:00100000:1.0:1784404633.503655:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840192 00000100:00100000:1.0:1784404633.503686:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784404633.503692:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:9904:x1871083728840192:12345-0@lo:502: 00000100:00100000:1.0:1784404633.503783:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:9904:x1871083728840192:12345-0@lo:502: Request processed in 91us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.503788:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784404633.503828:0:9904:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.503846:0:9904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9904:1871083728840192:0@lo:502: 00000100:00100000:1.0:1784404633.503904:0:9904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9904:1871083728840320:0@lo:502: 00000100:00100000:1.0:1784404633.503925:0:9904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.503937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840320 00000100:00100000:1.0:1784404633.503940:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840320 00000100:00100000:1.0:1784404633.503952:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784404633.503956:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:9904:x1871083728840320:12345-0@lo:502: 00000100:00100000:1.0:1784404633.503994:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:9904:x1871083728840320:12345-0@lo:502: Request processed in 37us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.503998:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784404633.504016:0:9904:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.504024:0:9904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9904:1871083728840320:0@lo:502: 00000040:00080000:1.0:1784404633.504036:0:9904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1784404633.504075:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1784404633.504088:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404633.504094:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504103:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404633.504115:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784404633.504117:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd565e88000 from 6 10000000:01000000:1.0:1784404633.504118:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784404633.504137:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504143:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504149:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.504156:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840448:0@lo:101: 00000100:00100000:1.0:1784404633.504286:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.504299:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.504310:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840448 00000100:00100000:1.0:1784404633.504313:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840448 00000100:00100000:1.0:1784404633.504332:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784404633.504338:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728840448:12345-0@lo:101: 00010000:00010000:1.0:1784404633.504346:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404633.504360:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d209200/0x24b3e2e6dcd78ca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ca1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504382:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d209200/0x24b3e2e6dcd78ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ca1 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504394:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d209200/0x24b3e2e6dcd78ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ca1 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504410:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209200, rc 0) 00000100:00100000:1.0:1784404633.504430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728840448:12345-0@lo:101: Request processed in 93us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.504434:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784404633.504454:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840448:0@lo:101: 00010000:00010000:1.0:1784404633.504463:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504470:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.504516:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840576:0@lo:256: 00000100:00100000:1.0:1784404633.504545:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.504558:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.504568:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840576 00000100:00100000:1.0:1784404633.504570:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840576 00000100:00100000:1.0:1784404633.504589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784404633.504594:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728840576:12345-0@lo:256: 20000000:01000000:1.0:1784404633.504604:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784404633.504619:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784404633.504622:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1784404633.504688:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728840576:12345-0@lo:256: Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.504694:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784404633.504722:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840576:0@lo:256: 10000000:01000000:1.0:1784404633.504761:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784404633.504770:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504777:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404633.504783:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784404633.504785:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1784404633.504787:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784404633.504801:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504807:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504815:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.504826:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840704:0@lo:101: 00000100:00100000:1.0:1784404633.504871:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.504884:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c480 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.504894:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840704 00000100:00100000:1.0:1784404633.504897:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840704 00000100:00100000:1.0:1784404633.504917:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784404633.504923:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728840704:12345-0@lo:101: 00010000:00010000:1.0:1784404633.504929:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404633.504937:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78caf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504949:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504963:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.504970:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167e200, rc 0) 00000100:00100000:1.0:1784404633.504996:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728840704:12345-0@lo:101: Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.505001:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784404633.505028:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840704:0@lo:101: 00010000:00010000:1.0:1784404633.505038:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.505045:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.505083:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840832:0@lo:501: 00000100:00100000:1.0:1784404633.505104:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.505116:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c480 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.505125:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840832 00000100:00100000:1.0:1784404633.505128:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840832 00000100:00100000:1.0:1784404633.505147:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784404633.505152:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728840832:12345-0@lo:501: 00000100:00100000:1.0:1784404633.506585:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728840832:12345-0@lo:501: Request processed in 1428us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.506594:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784404633.506643:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840832:0@lo:501: 00000100:00100000:1.0:1784404633.506683:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840960:0@lo:503: 00000100:00100000:1.0:1784404633.506726:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.506744:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.508344:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728840960 00000100:00100000:0.0:1784404633.508356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728840960 00000100:00100000:0.0:1784404633.508969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784404633.508983:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728840960:12345-0@lo:503: 00000100:00100000:0.0:1784404633.509145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728840960:12345-0@lo:503: Request processed in 166us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.509153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784404633.509308:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728840960:0@lo:503: 00000100:00100000:2.0:1784404633.509965:0:9905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9905:1871083728841088:0@lo:502: 00000100:00100000:2.0:1784404633.510011:0:9905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.510043:0:9905:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.510092:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841088 00000100:00100000:1.0:1784404633.510097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841088 00000100:00100000:1.0:1784404633.510133:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784404633.510140:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:9905:x1871083728841088:12345-0@lo:502: 00000100:00100000:1.0:1784404633.510329:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:9905:x1871083728841088:12345-0@lo:502: Request processed in 188us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.510336:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784404633.514303:0:9905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9905:1871083728841088:0@lo:502: 00000020:01000000:0.0:1784404633.514351:0:9905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784404633.514360:0:9905:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784404633.514369:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404633.514377:0:9905:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784404633.514384:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784404633.514388:0:9905:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:0.0:1784404633.514413:0:9905:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784404633.514416:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784404633.514433:0:9905:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dd573a899c0) 00000020:00000080:0.0:1784404633.514456:0:9905:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1784404633.514462:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784404633.514580:0:9905:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1784404633.514587:0:9905:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784404633.514595:0:9905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd78cc4 00010000:00080000:0.0:1784404633.514625:0:9905:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd442730800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:0.0:1784404633.514835:0:9905:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1784404633.514984:0:9905:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784404633.514997:0:9905:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1784404633.515295:0:9905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404633.515412:0:9905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404633.515548:0:9905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784404633.515632:0:9905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1784404633.518549:0:9907:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404633.518557:0:9907:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784404633.518958:0:9905:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784404633.518968:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784404633.519000:0:9905:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784404633.519020:0:9905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd78ccb 00000100:00080000:3.0:1784404633.519028:0:9905:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784404633.519033:0:9905:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd442730800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404633.519064:0:9905:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd4410b2680 x1871083728841216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404633.519088:0:9905:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1784404633.519135:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728841216:0@lo:8: 00000100:00100000:1.0:1784404633.520299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.520370:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841216 00000100:00100000:1.0:1784404633.520379:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841216 00000100:00100000:1.0:1784404633.520413:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784404633.520421:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728841216:12345-0@lo:8: 00010000:00080000:1.0:1784404633.520452:0:8431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1784404633.520481:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd78cd2 00002000:00100000:1.0:1784404633.520494:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dd44319a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1784404633.520498:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1784404633.520502:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1784404633.520565:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784404633.520777:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1784404633.520806:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd44319f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404633.520890:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083728841216:12345-0@lo:8: Request processed in 469us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.520906:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1784404633.520954:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b2680 x1871083728841216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.520964:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784404633.520972:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1784404633.520980:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784404633.520985:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784404633.520987:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd442730800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784404633.521000:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784404633.521004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728841216:0@lo:8: 00000004:00080000:1.0:1784404633.521027:0:9907:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784404633.521073:0:9907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 251405221060ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784404633.521079:0:9907:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:3.0:1784404633.522129:0:9905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404633.522137:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404633.522140:0:9905:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784404633.522143:0:9905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404633.522147:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404633.522149:0:9905:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784404633.522152:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784404633.522153:0:9905:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784404633.522199:0:9905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9905:1871083728841344:0@lo:502: 00000100:00100000:3.0:1784404633.522262:0:9905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.522307:0:9905:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551e7f000 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.522445:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841344 00000100:00100000:0.0:1784404633.522453:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841344 00000100:00100000:0.0:1784404633.522497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784404633.522505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:9905:x1871083728841344:12345-0@lo:502: 00000100:00100000:0.0:1784404633.522634:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:9905:x1871083728841344:12345-0@lo:502: Request processed in 129us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.522641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784404633.524308:0:9908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728841472:0@lo:700: 00000100:00100000:2.0:1784404633.524371:0:9908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.524413:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841472 00000100:00100000:2.0:1784404633.524418:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841472 00000100:00100000:2.0:1784404633.524456:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784404633.524461:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9908:x1871083728841472:12345-0@lo:700: 00000100:00100000:2.0:1784404633.524487:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1871083728841600:0@lo:700: 00000100:00100000:2.0:1784404633.524511:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.524524:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b840 going to sleep for 11 seconds 00000100:00080000:2.0:1784404633.524537:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404633.524547:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841600 00000100:00100000:2.0:1784404633.524549:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841600 00000100:00100000:2.0:1784404633.524568:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784404633.524572:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1871083728841600:12345-0@lo:700: 00000100:00080000:2.0:1784404633.524652:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404633.524661:0:9908:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.524747:0:9905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9905:1871083728841344:0@lo:502: 00000020:01000000:3.0:1784404633.524778:0:9905:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404633.524784:0:9905:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404633.524785:0:9905:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784404633.524789:0:9905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1784404633.524957:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1784404633.524978:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784404633.524986:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.524993:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404633.525006:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784404633.525008:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd544dfc000 from 39 10000000:01000000:2.0:1784404633.525010:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784404633.525028:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.525033:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.525040:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404633.525047:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728841728:0@lo:101: 00000100:00100000:2.0:1784404633.525067:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.525092:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b240 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.525123:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841728 00000100:00100000:3.0:1784404633.525125:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841728 00000100:00100000:3.0:1784404633.525147:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784404633.525151:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728841728:12345-0@lo:101: 00010000:00010000:3.0:1784404633.525157:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404633.525228:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78cd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.525249:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.525258:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.525282:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821db200, rc 0) 00000100:00100000:3.0:1784404633.525324:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728841728:12345-0@lo:101: Request processed in 171us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.525328:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784404633.525393:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728841728:0@lo:101: 00010000:00010000:2.0:1784404633.525405:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.525412:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404633.525447:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728841856:0@lo:501: 00000100:00100000:2.0:1784404633.525463:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.525480:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b240 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.525509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841856 00000100:00100000:3.0:1784404633.525513:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841856 00000100:00100000:3.0:1784404633.525534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784404633.525538:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728841856:12345-0@lo:501: 00000100:00100000:3.0:1784404633.525616:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728841856:12345-0@lo:501: Request processed in 77us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.525620:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784404633.525668:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728841856:0@lo:501: 00000100:00100000:2.0:1784404633.525692:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728841984:0@lo:503: 00000100:00100000:2.0:1784404633.525728:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.525744:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404633.525752:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728841984 00000100:00100000:2.0:1784404633.525755:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728841984 00000100:00100000:2.0:1784404633.525768:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784404633.525771:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728841984:12345-0@lo:503: 00000100:00100000:2.0:1784404633.525844:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728841984:12345-0@lo:503: Request processed in 70us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404633.525871:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784404633.525903:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728841984:0@lo:503: 00000100:00100000:2.0:1784404633.527290:0:9910:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9910:1871083728842112:0@lo:502: 00000100:00100000:2.0:1784404633.527348:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.527515:0:9910:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.529197:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728842368:0@lo:400: 00000100:00100000:1.0:1784404633.529257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.529300:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728842880:0@lo:400: 00000100:00100000:1.0:1784404633.529329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.529354:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784404633.529360:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728842240:0@lo:400: 00000100:00100000:1.0:1784404633.529394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.529414:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728842752:0@lo:400: 00000100:00100000:1.0:1784404633.529434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.529458:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728842624:0@lo:400: 00000100:00100000:1.0:1784404633.529480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.529497:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784404633.529509:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728842496:0@lo:400: 00000100:00100000:1.0:1784404633.529531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.529548:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728843008:0@lo:400: 00000100:00100000:1.0:1784404633.529570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.529592:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728842368 00000100:00100000:1.0:1784404633.529598:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728842368 00000100:00100000:1.0:1784404633.529631:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728842624 00000100:00100000:1.0:1784404633.529634:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728842624 00000100:00100000:1.0:1784404633.529651:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784404633.529659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728842368:12345-0@lo:400: 00000100:00100000:1.0:1784404633.529713:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728842368:12345-0@lo:400: Request processed in 54us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.529720:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784404633.529736:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784404633.529742:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728842624:12345-0@lo:400: 00000100:00100000:1.0:1784404633.529772:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728842624:12345-0@lo:400: Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.529778:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784404633.529796:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728842880 00000100:00100000:1.0:1784404633.529799:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728842880 00000100:00100000:1.0:1784404633.529829:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728842240 00000100:00100000:1.0:1784404633.529832:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728842240 00000100:00100000:1.0:1784404633.529841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728842752 00000100:00100000:1.0:1784404633.529843:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728842752 00000100:00100000:1.0:1784404633.529893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728842496 00000100:00100000:1.0:1784404633.529896:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728842496 00000100:00100000:1.0:1784404633.529904:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843008 00000100:00100000:1.0:1784404633.529906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843008 00000100:00100000:1.0:1784404633.529920:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784404633.529925:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728842880:12345-0@lo:400: 00000100:00100000:1.0:1784404633.529960:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728842880:12345-0@lo:400: Request processed in 35us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.529967:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784404633.529981:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784404633.529987:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728842240:12345-0@lo:400: 00000100:00100000:1.0:1784404633.530024:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728842240:12345-0@lo:400: Request processed in 37us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.530029:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784404633.530041:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404633.530047:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728842752:12345-0@lo:400: 00000100:00100000:1.0:1784404633.530068:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728842752:12345-0@lo:400: Request processed in 23us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.530073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404633.530082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784404633.530086:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728842496:12345-0@lo:400: 00000100:00100000:1.0:1784404633.530105:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728842496:12345-0@lo:400: Request processed in 18us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.530109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784404633.530117:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784404633.530121:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728843008:12345-0@lo:400: 00000100:00100000:1.0:1784404633.530140:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728843008:12345-0@lo:400: Request processed in 18us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.530145:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1784404633.530158:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404633.530161:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784404633.530184:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea2a00 x1871083728842496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.530203:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728842496:0@lo:400: 00010000:00080000:1.0:1784404633.530213:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea3100 x1871083728843008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.530220:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728843008:0@lo:400: 00000100:00100000:1.0:1784404633.530228:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728842624:0@lo:400: 00010000:00080000:1.0:1784404633.530255:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea1880 x1871083728842240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.530276:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728842240:0@lo:400: 00010000:00080000:1.0:1784404633.530286:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea3480 x1871083728842752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.530293:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728842752:0@lo:400: 00000100:00100000:1.0:1784404633.530301:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728842368:0@lo:400: 00010000:00080000:1.0:1784404633.530308:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea0380 x1871083728842880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.530316:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728842880:0@lo:400: 40000000:02000000:2.0:1784404633.538523:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1784404633.539010:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728842112 00000100:00100000:3.0:1784404633.539021:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728842112 00000100:00100000:3.0:1784404633.539551:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784404633.539562:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:9910:x1871083728842112:12345-0@lo:502: 00000100:00100000:3.0:1784404633.539737:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:9910:x1871083728842112:12345-0@lo:502: Request processed in 177us (12388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.539745:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784404633.541390:0:9910:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9910:1871083728842112:0@lo:502: 00000100:00100000:3.0:1784404633.541471:0:9910:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9910:1871083728843136:0@lo:502: 00000100:00100000:3.0:1784404633.541535:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.541578:0:9910:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5527120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.541761:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843136 00000100:00100000:0.0:1784404633.541768:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843136 00000100:00100000:0.0:1784404633.541815:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784404633.541825:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:9910:x1871083728843136:12345-0@lo:502: 00000100:00100000:0.0:1784404633.541972:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:9910:x1871083728843136:12345-0@lo:502: Request processed in 148us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.541979:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784404633.542549:0:9910:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9910:1871083728843136:0@lo:502: 00000040:00080000:1.0:1784404633.542579:0:9910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1784404633.546095:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1784404633.546153:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784404633.546183:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.546206:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404633.546219:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784404633.546222:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd544dfc000 from 6 10000000:01000000:3.0:1784404633.546225:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784404633.546285:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.546295:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.546309:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404633.546767:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843264:0@lo:101: 00000100:00100000:3.0:1784404633.547106:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404633.547351:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843264 00000100:00100000:0.0:1784404633.547360:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843264 00000100:00100000:3.0:1784404633.547414:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b600 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.547424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784404633.547436:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728843264:12345-0@lo:101: 00010000:00010000:0.0:1784404633.547453:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404633.547471:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151be00/0x24b3e2e6dcd78cee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ce7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.547501:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151be00/0x24b3e2e6dcd78cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ce7 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.547513:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151be00/0x24b3e2e6dcd78cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ce7 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.547522:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151be00, rc 0) 00000100:00100000:0.0:1784404633.547578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728843264:12345-0@lo:101: Request processed in 145us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.547586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784404633.547764:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843264:0@lo:101: 00010000:00010000:3.0:1784404633.547785:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.547893:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404633.547958:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843392:0@lo:256: 00000100:00100000:3.0:1784404633.547995:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.548033:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.548200:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843392 00000100:00100000:1.0:1784404633.548205:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843392 00000100:00100000:1.0:1784404633.548241:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784404633.548249:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728843392:12345-0@lo:256: 20000000:01000000:1.0:1784404633.548282:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784404633.548300:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784404633.548303:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1784404633.548392:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728843392:12345-0@lo:256: Request processed in 144us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.548400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784404633.548589:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843392:0@lo:256: 10000000:01000000:3.0:1784404633.548653:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784404633.548662:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.548671:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404633.548684:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784404633.548687:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1784404633.548690:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784404633.548716:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.548724:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.548733:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404633.548748:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843520:0@lo:101: 00000100:00100000:3.0:1784404633.548776:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.548804:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551e7f000 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.548882:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843520 00000100:00100000:1.0:1784404633.548888:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843520 00000100:00100000:1.0:1784404633.548920:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784404633.548927:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728843520:12345-0@lo:101: 00010000:00010000:1.0:1784404633.548936:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404633.548950:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78cf5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.548972:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.548982:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404633.548991:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167fc00, rc 0) 00000100:00100000:1.0:1784404633.549021:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728843520:12345-0@lo:101: Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.549028:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784404633.549105:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843520:0@lo:101: 00010000:00010000:3.0:1784404633.549117:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404633.549126:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404633.549190:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843648:0@lo:501: 00000100:00100000:3.0:1784404633.549215:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.549235:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551e7f000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.549249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843648 00000100:00100000:3.0:1784404633.549252:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843648 00000100:00100000:3.0:1784404633.549289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784404633.549296:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728843648:12345-0@lo:501: 00000100:00100000:3.0:1784404633.549433:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728843648:12345-0@lo:501: Request processed in 138us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.549441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784404633.549471:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843648:0@lo:501: 00000100:00100000:3.0:1784404633.549501:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843776:0@lo:503: 00000100:00100000:3.0:1784404633.549542:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.549556:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.549567:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843776 00000100:00100000:3.0:1784404633.549571:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843776 00000100:00100000:3.0:1784404633.549589:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784404633.549595:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728843776:12345-0@lo:503: 00000100:00100000:3.0:1784404633.549675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728843776:12345-0@lo:503: Request processed in 80us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.549681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784404633.549717:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728843776:0@lo:503: 00000100:00100000:1.0:1784404633.551993:0:9912:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9912:1871083728843904:0@lo:502: 00000100:00100000:1.0:1784404633.552066:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.552523:0:9912:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3180 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.552566:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728843904 00000100:00100000:3.0:1784404633.552574:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728843904 00000100:00100000:3.0:1784404633.552920:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784404633.552933:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:9912:x1871083728843904:12345-0@lo:502: 00000100:00100000:3.0:1784404633.553078:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:9912:x1871083728843904:12345-0@lo:502: Request processed in 148us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.553085:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784404633.553179:0:9912:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9912:1871083728843904:0@lo:502: 00000020:01000000:0.0:1784404633.553213:0:9912:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784404633.553222:0:9912:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784404633.553230:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404633.553233:0:9912:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784404633.553238:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784404633.553242:0:9912:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:0.0:1784404633.553279:0:9912:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784404633.553282:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784404633.553298:0:9912:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dd573a8b380) 00000020:00000080:0.0:1784404633.553321:0:9912:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1784404633.553326:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784404633.553426:0:9912:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784404633.553433:0:9912:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784404633.553439:0:9912:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd78d0a 00010000:00080000:0.0:1784404633.553470:0:9912:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd443585000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:0.0:1784404633.553687:0:9912:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1784404633.553820:0:9912:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784404633.553831:0:9912:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784404633.554016:0:9912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404633.554123:0:9912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404633.554274:0:9912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784404633.554376:0:9912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:2.0:1784404633.554469:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1871083728841600:12345-0@lo:700: Request processed in 29893us (29953us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404633.554482:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784404633.554497:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929f80 x1871083728841600/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404633.554511:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1871083728841600:0@lo:700: 40000000:02000000:0.0:1784404633.554522:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:3.0:1784404633.558332:0:9913:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784404633.558463:0:9913:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784404633.559474:0:9912:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784404633.559491:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784404633.559543:0:9912:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784404633.559572:0:9912:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd78d11 00000100:00080000:1.0:1784404633.559582:0:9912:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784404633.559588:0:9912:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd443585000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404633.559622:0:9912:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44348ca80 x1871083728844032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404633.559659:0:9912:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1784404633.559710:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728844032:0@lo:8: 00000020:01000000:1.0:1784404633.559756:0:9912:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404633.559761:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404633.559763:0:9912:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784404633.559767:0:9912:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404633.559771:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404633.559773:0:9912:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784404633.559776:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784404633.559778:0:9912:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784404633.559795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.559816:0:9912:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9912:1871083728844160:0@lo:502: 00000100:00100000:2.0:1784404633.559878:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844032 00000100:00100000:2.0:1784404633.559885:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844032 00000100:00100000:1.0:1784404633.559892:0:9912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.559921:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844160 00000100:00100000:2.0:1784404633.559925:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784404633.559927:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844160 00000100:00100000:2.0:1784404633.559934:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083728844032:12345-0@lo:8: 00010000:00080000:2.0:1784404633.559963:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000100:00100000:1.0:1784404633.559964:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784404633.559976:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:9912:x1871083728844160:12345-0@lo:502: 00000020:00000080:2.0:1784404633.559997:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd78d18 00002000:00100000:2.0:1784404633.560012:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dd44333c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784404633.560024:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1784404633.560028:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1784404633.560103:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:9912:x1871083728844160:12345-0@lo:502: Request processed in 128us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.560111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00002000:00080000:2.0:1784404633.560135:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784404633.560164:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9dd443339000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404633.560170:0:9912:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a61eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.560197:0:9912:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:9912:1871083728844160:0@lo:502: 00000100:00100000:2.0:1784404633.560211:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083728844032:12345-0@lo:8: Request processed in 276us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404633.560220:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:1.0:1784404633.560226:0:9912:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404633.560235:0:9912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404633.560237:0:9912:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784404633.560242:0:9912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00080000:2.0:1784404633.560253:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348ca80 x1871083728844032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404633.560273:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404633.560280:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784404633.560288:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784404633.560293:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784404633.560296:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784404633.560308:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784404633.560313:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728844032:0@lo:8: 00000004:00080000:1.0:1784404633.561816:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:1.0:1784404633.563754:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784404633.563767:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1784404633.563809:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784404633.563821:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.563835:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404633.563847:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784404633.563870:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd545b94d40 from 1 00000100:00100000:1.0:1784404633.563873:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9908:x1871083728841472:12345-0@lo:700: Request processed in 39388us (39479us total) trans 0 rc 0/0 10000000:01000000:2.0:1784404633.563875:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:1.0:1784404633.563893:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784404633.563917:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.563935:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404633.563946:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784404633.563963:0:9908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c928700 x1871083728841472/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404633.563969:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728844288:0@lo:101: 00000100:00100000:1.0:1784404633.563985:0:9908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728841472:0@lo:700: 00000100:00100000:2.0:1784404633.564026:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.564069:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd544eb5cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1784404633.565099:0:9913:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784404633.565275:0:9913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 251449422384ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784404633.565285:0:9913:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784404633.565578:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844288 00000100:00100000:1.0:1784404633.565587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844288 00000100:00100000:1.0:1784404633.565641:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784404633.565661:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728844288:12345-0@lo:101: 00010000:00010000:1.0:1784404633.565676:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404633.565914:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78d1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.566053:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.566066:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.566076:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167f000, rc 0) 00000100:00100000:0.0:1784404633.566152:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728844288:12345-0@lo:101: Request processed in 502us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.566189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784404633.566218:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728844416:0@lo:13: 00000100:00100000:0.0:1784404633.566244:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728844288:0@lo:101: 00000100:00100000:1.0:1784404633.566257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404633.566262:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.566284:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784404633.566309:0:9914:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784404633.566327:0:9914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728844544:0@lo:7: 00000100:00100000:0.0:1784404633.566355:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728844672:0@lo:501: 00000100:00100000:3.0:1784404633.566471:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844416 00000100:00100000:3.0:1784404633.566477:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844416 00000100:00100000:0.0:1784404633.566497:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.566519:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784404633.566521:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.566526:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728844416:12345-0@lo:13: 00000100:00100000:0.0:1784404633.566535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844672 00000100:00100000:0.0:1784404633.566539:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844672 00002000:00000024:3.0:1784404633.566549:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1784404633.566560:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784404633.566565:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728844672:12345-0@lo:501: 00000100:00100000:3.0:1784404633.566587:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728844416:12345-0@lo:13: Request processed in 63us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.566592:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1784404633.566609:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404633.566630:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728844672:12345-0@lo:501: Request processed in 65us (133us total) trans 0 rc -2/-2 00010000:00080000:3.0:1784404633.566635:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348d500 x1871083728844416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404633.566637:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784404633.566664:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728844416:0@lo:13: 00000100:00100000:0.0:1784404633.566664:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728844672:0@lo:501: 10000000:01000000:0.0:1784404633.566691:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784404633.566697:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404633.566706:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404633.567308:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.567433:0:9914:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404633.567472:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844544 00000100:00100000:3.0:1784404633.567477:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844544 00000100:00100000:3.0:1784404633.567544:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784404633.567552:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9914:x1871083728844544:12345-0@lo:7: 00002000:00080000:3.0:1784404633.572461:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1784404633.572471:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784404633.572639:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9914:x1871083728844544:12345-0@lo:7: Request processed in 5081us (5326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.572671:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1784404633.572810:0:9914:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348f480 x1871083728844544/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.572837:0:9914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728844544:0@lo:7: 00000004:00080000:1.0:1784404633.572994:0:9914:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1784404633.573052:0:9914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728844800:0@lo:5: 00000100:00100000:1.0:1784404633.573086:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.573105:0:9914:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404633.573243:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844800 00000100:00100000:2.0:1784404633.573250:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844800 00000100:00100000:2.0:1784404633.573308:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784404633.573317:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9914:x1871083728844800:12345-0@lo:5: 00002000:00080000:2.0:1784404633.573340:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784404633.573343:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:2.0:1784404633.575913:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:0.0:1784404633.576840:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1784404633.577324:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784404633.586487:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9914:x1871083728844800:12345-0@lo:5: Request processed in 13162us (13391us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784404633.586511:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1784404633.586679:0:9914:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348f480 x1871083728844800/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.586691:0:9914:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784404633.586698:0:9914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728844800:0@lo:5: 00000004:00080000:1.0:1784404633.586712:0:9914:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784404633.586757:0:9914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728844928:0@lo:700: 00000100:00100000:1.0:1784404633.586877:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.586907:0:9914:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404633.587043:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728844928 00000100:00100000:2.0:1784404633.587050:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728844928 00000100:00100000:2.0:1784404633.587097:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784404633.587107:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9914:x1871083728844928:12345-0@lo:700: 00000004:00080000:2.0:1784404633.590105:0:9908:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784404633.590141:0:9908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728845184:0@lo:7: 00000100:00100000:2.0:1784404633.590244:0:9908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.590306:0:9908:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd544eb5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.590428:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845184 00000100:00100000:0.0:1784404633.590437:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845184 00000100:00100000:0.0:1784404633.590499:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784404633.590510:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9908:x1871083728845184:12345-0@lo:7: 00000100:00100000:1.0:1784404633.593709:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728845056:0@lo:13: 00000100:00100000:1.0:1784404633.593793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.594185:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845056 00000100:00100000:3.0:1784404633.594194:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845056 00000100:00100000:3.0:1784404633.594637:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404633.594649:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1871083728845056:12345-0@lo:13: 00002000:00000024:3.0:1784404633.594710:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1784404633.594787:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1871083728845056:12345-0@lo:13: Request processed in 140us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404633.594795:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1784404633.594875:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd570591180 x1871083728845056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404633.594900:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728845056:0@lo:13: 00000100:00100000:1.0:1784404633.602098:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9914:x1871083728844928:12345-0@lo:700: Request processed in 14982us (15211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.602117:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784404633.602351:0:9914:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348f480 x1871083728844928/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.602370:0:9914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728844928:0@lo:700: 00002000:00080000:2.0:1784404633.605400:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1784404633.605423:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784404633.605526:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9908:x1871083728845184:12345-0@lo:7: Request processed in 15014us (15278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404633.605538:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1784404633.605603:0:9908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd570591500 x1871083728845184/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404633.605619:0:9908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728845184:0@lo:7: 00000004:00080000:2.0:1784404633.605636:0:9908:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784404633.606067:0:9908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443181f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728845312:0@lo:5: 00000100:00100000:2.0:1784404633.606109:0:9908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404633.606154:0:9908:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd544eb5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.609609:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845312 00000100:00100000:1.0:1784404633.609627:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845312 00000100:00100000:1.0:1784404633.609825:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404633.609844:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9908:x1871083728845312:12345-0@lo:5: 00002000:00080000:1.0:1784404633.609900:0:8488:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1784404633.610002:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9908:x1871083728845312:12345-0@lo:5: Request processed in 161us (3893us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404633.610010:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1784404633.610059:0:9908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443181f80 x1871083728845312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404633.610074:0:9908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443181f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728845312:0@lo:5: 00000004:00080000:3.0:1784404633.610088:0:9908:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1784404633.610131:0:9908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728845440:0@lo:5: 00000100:00100000:3.0:1784404633.610181:0:9908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.610223:0:9908:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67540 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.610229:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845440 00000100:00100000:1.0:1784404633.610234:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845440 00000100:00100000:1.0:1784404633.610281:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404633.610288:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9908:x1871083728845440:12345-0@lo:5: 00002000:00080000:1.0:1784404633.610316:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:02000040:3.0:1784404633.611144:0:9914:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1784404633.612974:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9908:x1871083728845440:12345-0@lo:5: Request processed in 2679us (2785us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784404633.612988:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1784404633.613099:0:9908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b2300 x1871083728845440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.613116:0:9908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9908:1871083728845440:0@lo:5: 00000004:00080000:1.0:1784404633.613132:0:9908:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784404633.613180:0:9908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9908:1871083728845568:0@lo:900: 00000100:00100000:1.0:1784404633.613220:0:9908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404633.613254:0:9908:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77900 going to sleep for 11 seconds 00000100:00100000:0.0:1784404633.613324:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845568 00000100:00100000:0.0:1784404633.613334:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845568 00000100:00100000:0.0:1784404633.613391:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404633.613400:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9908:x1871083728845568:12345-0@lo:900: 00000100:00100000:0.0:1784404633.613455:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9908:x1871083728845568:12345-0@lo:900: Request processed in 56us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404633.613465:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784404633.615467:0:9908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348f480 x1871083728845568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404633.615499:0:9908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9908:1871083728845568:0@lo:900: 00000100:00100000:3.0:1784404633.619704:0:9914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728845696:0@lo:5: 00000100:00100000:3.0:1784404633.619791:0:9914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404633.620103:0:9914:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404633.620534:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845696 00000100:00100000:1.0:1784404633.620543:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845696 00000100:00100000:1.0:1784404633.620608:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784404633.620626:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9914:x1871083728845696:12345-0@lo:5: 00002000:00080000:3.0:1784404633.628691:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1784404633.628712:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1784404633.631996:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9914:x1871083728845696:12345-0@lo:5: Request processed in 11365us (12197us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784404633.632010:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1784404633.637642:0:9914:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b1880 x1871083728845696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404649 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404633.637665:0:9914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9914:1871083728845696:0@lo:5: 00000004:00080000:2.0:1784404633.637683:0:9914:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:2.0:1784404633.757591:0:9934:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404633.758385:0:9934:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404633.867779:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784404634.691410:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1784404634.691565:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1784404634.883538:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404635.012370:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728845824:0@lo:41: 00000100:00100000:3.0:1784404635.012450:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404635.012608:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845824 00000100:00100000:2.0:1784404635.012616:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845824 00000100:00100000:2.0:1784404635.012671:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404635.012683:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728845824:12345-0@lo:41: 00000004:00000024:2.0:1784404635.012719:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404635.012772:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728845824:12345-0@lo:41: Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404635.012793:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784404635.013080:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728845824:0@lo:41: 00010000:00010000:0.0:1784404635.908494:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404636.036057:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404636.036087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728845952:0@lo:41: 00000100:00100000:3.0:1784404636.036161:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404636.036277:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728845952 00000100:00100000:2.0:1784404636.036288:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728845952 00000100:00100000:2.0:1784404636.036352:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404636.036362:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728845952:12345-0@lo:41: 00000004:00000024:2.0:1784404636.036397:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784404636.036447:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728845952:12345-0@lo:41: Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404636.036455:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404636.036503:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728845952:0@lo:41: 00000020:00000004:0.0:1784404636.751471:0:10035:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404636.751907:0:10035:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784404636.938622:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784404637.867251:0:10083:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404637.867262:0:10083:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1784404637.965187:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404638.478269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404638.478354:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707826304 00000100:00100000:0.0:1784404638.478365:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707826304 00000100:00100000:0.0:1784404638.478417:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:0.0:1784404638.478426:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2400:x1871083707826304:12345-192.168.202.42@tcp:250: 00010000:00080000:0.0:1784404638.478456:0:6513:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fb7a08a7-c908-4c30-ba67-617d22aac8ae@192.168.202.42@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1784404638.478481:0:6513:0:(genops.c:1385:class_connect()) connect: client fb7a08a7-c908-4c30-ba67-617d22aac8ae, cookie 0x24b3e2e6dcd78d2d 00000100:00080000:0.0:1784404638.478618:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404638.478964:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+5:2400:x1871083707826304:12345-192.168.202.42@tcp:250: Request processed in 537us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404638.478990:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:3.0:1784404638.498997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404638.499258:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707826432 00000100:00100000:0.0:1784404638.499269:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707826432 00000100:00100000:0.0:1784404638.499339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:0.0:1784404638.499350:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+5:6159:x1871083707826432:12345-192.168.202.42@tcp:101: 00010000:00010000:0.0:1784404638.499367:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404638.499388:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7054 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404638.499416:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404638.499426:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404638.499434:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a000, rc 0) 00000100:00100000:0.0:1784404638.499496:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+6:6159:x1871083707826432:12345-192.168.202.42@tcp:101: Request processed in 148us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404638.499503:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:3.0:1784404638.511841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404638.512334:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707826560 00000100:00100000:0.0:1784404638.512346:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707826560 00000100:00100000:0.0:1784404638.512437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:0.0:1784404638.512449:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+6:6159:x1871083707826560:12345-192.168.202.42@tcp:501: 00000100:00100000:0.0:1784404638.512583:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+6:6159:x1871083707826560:12345-192.168.202.42@tcp:501: Request processed in 136us (751us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784404638.512592:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:2.0:1784404638.522674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404638.522766:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707826688 00000100:00100000:1.0:1784404638.522775:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707826688 00000100:00100000:1.0:1784404638.522831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:1.0:1784404638.522841:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+6:6159:x1871083707826688:12345-192.168.202.42@tcp:101: 00010000:00010000:1.0:1784404638.522894:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404638.522914:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed705b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404638.522943:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404638.522954:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404638.522963:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167e400, rc 0) 00000100:00100000:1.0:1784404638.523026:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+7:6159:x1871083707826688:12345-192.168.202.42@tcp:101: Request processed in 186us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404638.523033:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:3.0:1784404638.526809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404638.526921:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707826816 00000100:00100000:2.0:1784404638.526931:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707826816 00000100:00100000:2.0:1784404638.526988:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 183 00000100:00100000:2.0:1784404638.526999:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+7:6159:x1871083707826816:12345-192.168.202.42@tcp:501: 00000100:00100000:2.0:1784404638.529564:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6159:x1871083707826816:12345-192.168.202.42@tcp:501: Request processed in 2556us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.529579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 183 00000100:00100000:0.0:1784404638.545397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404638.548044:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707826944 00000100:00100000:3.0:1784404638.548063:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707826944 00000100:00100000:3.0:1784404638.548234:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:3.0:1784404638.548250:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6159:x1871083707826944:12345-192.168.202.42@tcp:503: 00000100:00100000:3.0:1784404638.553094:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6159:x1871083707826944:12345-192.168.202.42@tcp:503: Request processed in 4836us (7693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404638.553110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:0.0:1784404638.564057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404638.567916:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827072 00000100:00100000:2.0:1784404638.567935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827072 00000100:00100000:2.0:1784404638.568025:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:2.0:1784404638.568037:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6178:x1871083707827072:12345-192.168.202.42@tcp:502: 00000100:00100000:2.0:1784404638.568272:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6178:x1871083707827072:12345-192.168.202.42@tcp:502: Request processed in 237us (4227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.568281:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:3.0:1784404638.595416:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728846080:0@lo:13: 00000100:00100000:3.0:1784404638.595507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404638.595592:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404638.595616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728846208:0@lo:13: 00000100:00100000:3.0:1784404638.595643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404638.595671:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846080 00000100:00100000:3.0:1784404638.595679:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846080 00000100:00100000:3.0:1784404638.595722:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846208 00000100:00100000:3.0:1784404638.595725:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846208 00000100:00100000:3.0:1784404638.595742:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404638.595751:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728846080:12345-0@lo:13: 00002000:00000024:3.0:1784404638.595783:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404638.595826:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728846080:12345-0@lo:13: Request processed in 76us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404638.595833:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404638.596008:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404638.596020:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728846336:0@lo:13: 00000100:00100000:1.0:1784404638.596050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404638.596079:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846336 00000100:00100000:1.0:1784404638.596082:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846336 00000100:00080000:0.0:1784404638.596206:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404638.596210:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784404638.596255:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b2d80 x1871083728846080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404638.596266:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1784404638.596285:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728846080:0@lo:13: 00000100:00100000:0.0:1784404638.596295:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404638.596300:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728846464:0@lo:13: 00000100:00100000:0.0:1784404638.596329:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404638.597404:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784404638.597425:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728846208:12345-0@lo:13: 00002000:00000024:3.0:1784404638.597455:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404638.597515:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728846208:12345-0@lo:13: Request processed in 99us (1871us total) trans 0 rc 0/0 00010000:00080000:0.0:1784404638.597606:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b3100 x1871083728846208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404638.597625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728846208:0@lo:13: 00000100:00100000:2.0:1784404638.600136:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728846848:0@lo:400: 00000100:00100000:2.0:1784404638.600201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600249:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728847360:0@lo:400: 00000100:00100000:2.0:1784404638.600275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600300:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784404638.600305:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728846720:0@lo:400: 00000100:00100000:2.0:1784404638.600324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600340:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728847232:0@lo:400: 00000100:00100000:2.0:1784404638.600358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600392:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846848 00000100:00100000:2.0:1784404638.600399:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846848 00000100:00100000:2.0:1784404638.600448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404638.600456:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728846848:12345-0@lo:400: 00000100:00100000:2.0:1784404638.600508:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728846848:12345-0@lo:400: Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.600515:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404638.600539:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728847360 00000100:00100000:2.0:1784404638.600542:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728847360 00000100:00100000:2.0:1784404638.600572:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846720 00000100:00100000:2.0:1784404638.600575:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846720 00000100:00100000:2.0:1784404638.600586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728847232 00000100:00100000:2.0:1784404638.600588:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728847232 00000100:00100000:2.0:1784404638.600602:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784404638.600607:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728847360:12345-0@lo:400: 00000100:00100000:2.0:1784404638.600646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728847360:12345-0@lo:400: Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.600665:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784404638.600678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784404638.600683:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728846720:12345-0@lo:400: 00000100:00100000:2.0:1784404638.600708:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728846720:12345-0@lo:400: Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.600713:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784404638.600724:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784404638.600730:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728847232:12345-0@lo:400: 00000100:00100000:2.0:1784404638.600754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728847232:12345-0@lo:400: Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.600760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784404638.600792:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728846592:0@lo:400: 00000100:00100000:2.0:1784404638.600822:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600873:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728847104:0@lo:400: 00000100:00100000:2.0:1784404638.600894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600908:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728847616:0@lo:400: 00000100:00100000:2.0:1784404638.600929:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600946:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784404638.600952:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728846976:0@lo:400: 00000100:00100000:2.0:1784404638.600973:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.600989:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728847488:0@lo:400: 00000100:00100000:2.0:1784404638.601022:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404638.601046:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728847616 00000100:00100000:2.0:1784404638.601055:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728847616 00000100:00100000:2.0:1784404638.601074:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846976 00000100:00100000:2.0:1784404638.601077:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846976 00000100:00100000:2.0:1784404638.601085:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728847488 00000100:00100000:2.0:1784404638.601087:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728847488 00000100:00100000:2.0:1784404638.601098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784404638.601104:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728847616:12345-0@lo:400: 00000100:00100000:2.0:1784404638.601136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728847616:12345-0@lo:400: Request processed in 32us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.601143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784404638.601154:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784404638.601159:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728846976:12345-0@lo:400: 00000100:00100000:2.0:1784404638.601184:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728846976:12345-0@lo:400: Request processed in 25us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.601189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784404638.601200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784404638.601206:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728847488:12345-0@lo:400: 00000100:00100000:2.0:1784404638.601240:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728847488:12345-0@lo:400: Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.601246:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784404638.601260:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728847104 00000100:00100000:2.0:1784404638.601263:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728847104 00000100:00100000:2.0:1784404638.601280:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784404638.601285:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728847104:12345-0@lo:400: 00000100:00100000:2.0:1784404638.601310:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728847104:12345-0@lo:400: Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.601316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1784404638.601352:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443181180 x1871083728846720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404638.601371:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728846720:0@lo:400: 00010000:00080000:2.0:1784404638.601384:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443182680 x1871083728847232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404638.601392:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728847232:0@lo:400: 00000100:00100000:2.0:1784404638.601400:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728846848:0@lo:400: 00010000:00080000:2.0:1784404638.601408:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443183b80 x1871083728847360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404638.601416:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728847360:0@lo:400: 00010000:00080000:2.0:1784404638.601452:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443181c00 x1871083728846976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404638.601460:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728846976:0@lo:400: 00010000:00080000:2.0:1784404638.601468:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443182300 x1871083728847488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404638.601474:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728847488:0@lo:400: 00000100:00100000:2.0:1784404638.601481:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728847104:0@lo:400: 00010000:00080000:2.0:1784404638.601488:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443180700 x1871083728847616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404638.601495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728847616:0@lo:400: 00000100:00100000:1.0:1784404638.601549:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1784404638.601557:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846592 00000100:00100000:1.0:1784404638.601559:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1784404638.601563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846592 00000100:00100000:2.0:1784404638.601594:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784404638.601609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728846592:12345-0@lo:400: 00000100:00100000:2.0:1784404638.601646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728846592:12345-0@lo:400: Request processed in 40us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.601653:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784404638.601688:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728846592:0@lo:400: 00000100:00100000:1.0:1784404638.601722:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728846464 00000100:00100000:1.0:1784404638.601729:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728846464 00000100:00100000:2.0:1784404638.601798:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404638.601807:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728846336:12345-0@lo:13: 00002000:00000024:2.0:1784404638.601823:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404638.601896:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728846336:12345-0@lo:13: Request processed in 91us (5845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.601902:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404638.601915:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404638.601921:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728846464:12345-0@lo:13: 00002000:00000024:2.0:1784404638.601931:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404638.601960:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728846464:12345-0@lo:13: Request processed in 40us (5631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.601966:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1784404638.601990:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd441abc380 x1871083728846464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404638.602005:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728846464:0@lo:13: 00000100:00100000:3.0:1784404638.602018:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1784404638.602407:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404638.602413:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404638.602415:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784404638.602526:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348f480 x1871083728846336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404638.602537:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784404638.602551:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728846336:0@lo:13: 00000100:00100000:2.0:1784404638.619043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404638.619258:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827200 00000100:00100000:1.0:1784404638.619271:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827200 00000100:00100000:1.0:1784404638.619348:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:1.0:1784404638.619361:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6178:x1871083707827200:12345-192.168.202.42@tcp:502: 00000100:00100000:1.0:1784404638.619564:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6178:x1871083707827200:12345-192.168.202.42@tcp:502: Request processed in 205us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404638.619574:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:0.0:1784404638.627187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404638.627329:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827328 00000100:00100000:2.0:1784404638.627339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827328 00000100:00100000:2.0:1784404638.627387:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:2.0:1784404638.627397:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6159:x1871083707827328:12345-192.168.202.42@tcp:101: 00010000:00010000:2.0:1784404638.627430:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404638.627448:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78d42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed708c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404638.627493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed708c expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404638.627505:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed708c expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404638.627517:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541390200, rc 0) 00000100:00100000:2.0:1784404638.627585:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6159:x1871083707827328:12345-192.168.202.42@tcp:101: Request processed in 189us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.627592:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:0.0:1784404638.636001:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404638.636142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827456 00000100:00100000:2.0:1784404638.636152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827456 00000100:00100000:2.0:1784404638.636212:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:2.0:1784404638.636232:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6159:x1871083707827456:12345-192.168.202.42@tcp:256: 20000000:01000000:2.0:1784404638.636262:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784404638.636288:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784404638.636292:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784404638.636295:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784404638.636298:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784404638.636301:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1784404638.638314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6159:x1871083707827456:12345-192.168.202.42@tcp:256: Request processed in 2078us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.638327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:1.0:1784404638.640789:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404638.640887:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827584 00000100:00100000:0.0:1784404638.640898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827584 00000100:00100000:0.0:1784404638.641054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:0.0:1784404638.641064:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6159:x1871083707827584:12345-192.168.202.42@tcp:101: 00010000:00010000:0.0:1784404638.641080:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404638.641096:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7093 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404638.641122:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404638.641145:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404638.641155:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a400, rc 0) 00000100:00100000:0.0:1784404638.641446:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6159:x1871083707827584:12345-192.168.202.42@tcp:101: Request processed in 382us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404638.641454:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:0.0:1784404638.646721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404638.646878:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827712 00000100:00100000:2.0:1784404638.646919:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827712 00000100:00100000:2.0:1784404638.646979:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:2.0:1784404638.646988:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6159:x1871083707827712:12345-192.168.202.42@tcp:501: 00000100:00100000:2.0:1784404638.647134:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6159:x1871083707827712:12345-192.168.202.42@tcp:501: Request processed in 146us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.647142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:3.0:1784404638.654198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404638.654321:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827840 00000100:00100000:0.0:1784404638.654331:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827840 00000100:00100000:0.0:1784404638.654389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:0.0:1784404638.654399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6159:x1871083707827840:12345-192.168.202.42@tcp:503: 00000100:00100000:0.0:1784404638.654547:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6159:x1871083707827840:12345-192.168.202.42@tcp:503: Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404638.654555:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:1.0:1784404638.666483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404638.666704:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707827968 00000100:00100000:0.0:1784404638.666715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707827968 00000100:00100000:0.0:1784404638.666775:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:0.0:1784404638.666785:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6183:x1871083707827968:12345-192.168.202.42@tcp:502: 00000100:00100000:0.0:1784404638.666993:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6183:x1871083707827968:12345-192.168.202.42@tcp:502: Request processed in 208us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404638.667001:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:1.0:1784404638.672137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404638.672252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828096 00000100:00100000:2.0:1784404638.672264:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828096 00000100:00100000:2.0:1784404638.672338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:2.0:1784404638.672350:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6183:x1871083707828096:12345-192.168.202.42@tcp:502: 00000100:00100000:2.0:1784404638.672521:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6183:x1871083707828096:12345-192.168.202.42@tcp:502: Request processed in 174us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404638.672529:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:3.0:1784404638.681012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404638.681063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404638.681213:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828224 00000100:00100000:0.0:1784404638.681445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828224 00000100:00100000:0.0:1784404638.681497:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828480 00000100:00100000:0.0:1784404638.681514:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828480 00000100:00100000:0.0:1784404638.681542:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784404638.681550:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1871083707828224:12345-192.168.202.42@tcp:38: 00010000:00080000:0.0:1784404638.681582:0:6520:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1784404638.681638:0:6520:0:(genops.c:1385:class_connect()) connect: client 1827e730-172d-4769-8ecb-95f4e65fc8a0, cookie 0x24b3e2e6dcd78d50 00000004:00100000:0.0:1784404638.681666:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784404638.681924:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9dd443580000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404638.681994:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2400:x1871083707828224:12345-192.168.202.42@tcp:38: Request processed in 443us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404638.682003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784404638.682024:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1784404638.682029:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1871083707828480:12345-192.168.202.42@tcp:38: 00010000:00080000:0.0:1784404638.682045:0:6520:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1784404638.682077:0:6520:0:(genops.c:1385:class_connect()) connect: client 1827e730-172d-4769-8ecb-95f4e65fc8a0, cookie 0x24b3e2e6dcd78d57 00000004:00100000:0.0:1784404638.682092:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784404638.684252:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9dd443587800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404638.684339:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2400:x1871083707828480:12345-192.168.202.42@tcp:38: Request processed in 2305us (3272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404638.684351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00010000:00010000:2.0:1784404638.979165:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404639.687289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404639.687408:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828352 00000100:00100000:1.0:1784404639.687419:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828352 00000100:00100000:1.0:1784404639.687505:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:1.0:1784404639.687517:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:0:x1871083707828352:12345-192.168.202.42@tcp:41: 00000004:00000024:1.0:1784404639.687571:0:9527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1784404639.687640:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:0:x1871083707828352:12345-192.168.202.42@tcp:41: Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404639.687647:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00080000:2.0:1784404639.687840:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404639.691516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404639.691660:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828736 00000100:00100000:0.0:1784404639.691671:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828736 00000100:00100000:0.0:1784404639.691743:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:0.0:1784404639.691754:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707828736:12345-192.168.202.42@tcp:41: 00000004:00000024:0.0:1784404639.691791:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784404639.691897:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707828736:12345-192.168.202.42@tcp:41: Request processed in 144us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404639.691930:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784404639.692184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404639.692411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828608 00000100:00100000:2.0:1784404639.692416:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828608 00000100:00100000:2.0:1784404639.692469:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:2.0:1784404639.692478:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:0:x1871083707828608:12345-192.168.202.42@tcp:41: 00000004:00000024:2.0:1784404639.692499:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404639.692536:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:0:x1871083707828608:12345-192.168.202.42@tcp:41: Request processed in 59us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404639.692542:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00080000:3.0:1784404639.692675:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404639.702228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404639.702356:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828864 00000100:00100000:0.0:1784404639.702368:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828864 00000100:00100000:0.0:1784404639.702439:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1784404639.702451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707828864:12345-192.168.202.42@tcp:40: 00000100:00100000:0.0:1784404639.703673:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707828864:12345-192.168.202.42@tcp:40: Request processed in 1215us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404639.703686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:3.0:1784404639.705604:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404639.705635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404639.705654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404639.705693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404639.705721:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707828992 00000100:00100000:0.0:1784404639.705733:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707828992 00000100:00100000:0.0:1784404639.705771:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707829120 00000100:00100000:0.0:1784404639.705774:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707829120 00000100:00100000:2.0:1784404639.705896:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:2.0:1784404639.706014:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1871083707828992:12345-192.168.202.42@tcp:8: 00010000:00080000:2.0:1784404639.706051:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1784404639.706105:0:8433:0:(genops.c:1385:class_connect()) connect: client 1827e730-172d-4769-8ecb-95f4e65fc8a0, cookie 0x24b3e2e6dcd78d5e 00002000:00100000:2.0:1784404639.706126:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1827e730-172d-4769-8ecb-95f4e65fc8a0/ffff9dd44333a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784404639.706139:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784404639.706367:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784404639.706403:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9dd44333e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404639.706451:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1784404639.706458:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1871083707829120:12345-192.168.202.42@tcp:8: 00010000:00080000:0.0:1784404639.706474:0:8431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp t0 exp 0000000000000000 cur 257 last 0 00000100:00100000:2.0:1784404639.706479:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2400:x1871083707828992:12345-192.168.202.42@tcp:8: Request processed in 573us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404639.706486:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000020:00000080:0.0:1784404639.706492:0:8431:0:(genops.c:1385:class_connect()) connect: client 1827e730-172d-4769-8ecb-95f4e65fc8a0, cookie 0x24b3e2e6dcd78d65 00002000:00100000:0.0:1784404639.706497:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1827e730-172d-4769-8ecb-95f4e65fc8a0/ffff9dd443580800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784404639.706504:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784404639.706662:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784404639.706680:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd443586000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404639.706707:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2400:x1871083707829120:12345-192.168.202.42@tcp:8: Request processed in 250us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404639.706714:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1784404639.706938:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707829248 00000100:00100000:1.0:1784404639.706954:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707829248 00000100:00100000:1.0:1784404639.706993:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:1.0:1784404639.707001:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707829248:12345-192.168.202.42@tcp:900: 00000100:00100000:1.0:1784404639.707037:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707829248:12345-192.168.202.42@tcp:900: Request processed in 37us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404639.707045:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:1.0:1784404639.707068:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707829376 00000100:00100000:1.0:1784404639.707073:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707829376 00000100:00100000:1.0:1784404639.707100:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:1.0:1784404639.708319:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2402:x1871083707829376:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1784404639.708392:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2402:x1871083707829376:12345-192.168.202.42@tcp:400: Request processed in 86us (2696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404639.708400:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:3.0:1784404639.709004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404639.709276:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707829504 00000100:00100000:2.0:1784404639.709284:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707829504 00000100:00100000:2.0:1784404639.709339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1784404639.709348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707829504:12345-192.168.202.42@tcp:33: 00000004:00080000:0.0:1784404639.725761:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16328us 00000004:00200000:2.0:1784404639.777059:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784404639.777174:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6159:x1871083707829504:12345-192.168.202.42@tcp:33: Request processed in 67821us (68167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404639.777185:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:3.0:1784404639.995800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404639.996077:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707829632 00000100:00100000:0.0:1784404639.996103:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707829632 00000100:00100000:0.0:1784404639.996159:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:0.0:1784404639.996171:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6201:x1871083707829632:12345-192.168.202.42@tcp:101: 00010000:00010000:0.0:1784404639.996195:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404639.996271:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b600/0x24b3e2e6dcd78d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed70c4 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404639.996344:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78d73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404639.996358:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404639.996373:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404639.996419:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784404639.996423:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404639.996440:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404639.996466:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b600/0x24b3e2e6dcd78d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70c4 expref: 8 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404639.996486:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78d73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70c4 expref: 7 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404639.996495:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd44330fb00) 00010000:00010000:0.0:1784404639.996498:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404639.996502:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a600, rc 0) 00000100:00100000:0.0:1784404639.997819:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:6201:x1871083707829632:12345-192.168.202.42@tcp:101: Request processed in 1641us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404639.997830:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00010000:00010000:0.0:1784404640.003024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404640.132454:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404640.132490:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728847744:0@lo:41: 00000100:00100000:3.0:1784404640.132598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404640.132947:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728847744 00000100:00100000:2.0:1784404640.132958:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728847744 00000100:00100000:2.0:1784404640.133027:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784404640.133037:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728847744:12345-0@lo:41: 00000004:00000024:2.0:1784404640.133077:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404640.133143:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728847744:12345-0@lo:41: Request processed in 107us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404640.133151:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784404640.133264:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728847744:0@lo:41: 00010000:00010000:2.0:1784404641.027121:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404641.155688:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728847872:0@lo:41: 00000100:00100000:1.0:1784404641.155752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404641.155847:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728847872 00000100:00100000:3.0:1784404641.155876:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728847872 00000100:00100000:3.0:1784404641.155911:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784404641.155918:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728847872:12345-0@lo:41: 00000004:00000024:3.0:1784404641.155949:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784404641.156002:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728847872:12345-0@lo:41: Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404641.156008:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784404641.156111:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728847872:0@lo:41: 00010000:00010000:0.0:1784404642.051106:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404642.221982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404642.223137:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707829760 00000100:00100000:0.0:1784404642.223150:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707829760 00000100:00100000:0.0:1784404642.223249:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:0.0:1784404642.223261:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:6253:x1871083707829760:12345-192.168.202.42@tcp:41: 00000100:00080000:3.0:1784404642.223508:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1784404642.223658:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784404642.223732:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:6253:x1871083707829760:12345-192.168.202.42@tcp:41: Request processed in 472us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404642.223740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1784404642.227376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404642.227661:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707829888 00000100:00100000:3.0:1784404642.227672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707829888 00000100:00100000:3.0:1784404642.227755:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:3.0:1784404642.227767:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6253:x1871083707829888:12345-192.168.202.42@tcp:41: 00000004:00000024:3.0:1784404642.227818:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784404642.227943:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6253:x1871083707829888:12345-192.168.202.42@tcp:41: Request processed in 178us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404642.227951:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00080000:2.0:1784404642.228026:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404642.231791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404642.232289:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830016 00000100:00100000:1.0:1784404642.232302:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830016 00000100:00100000:1.0:1784404642.232408:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404642.232421:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6253:x1871083707830016:12345-192.168.202.42@tcp:13: 00002000:00000024:1.0:1784404642.232459:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784404642.232619:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404642.232701:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6253:x1871083707830016:12345-192.168.202.42@tcp:13: Request processed in 282us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404642.232728:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404642.239791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404642.239883:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830144 00000100:00100000:3.0:1784404642.239893:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830144 00000100:00100000:3.0:1784404642.239966:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1784404642.239977:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6253:x1871083707830144:12345-192.168.202.42@tcp:13: 00002000:00000024:3.0:1784404642.240010:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784404642.240045:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784404642.240102:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:6253:x1871083707830144:12345-192.168.202.42@tcp:13: Request processed in 127us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404642.240111:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00010000:00010000:2.0:1784404643.079290:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404643.715236:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728848000:0@lo:13: 00000100:00100000:1.0:1784404643.715320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404643.715423:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848000 00000100:00100000:1.0:1784404643.715431:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848000 00000100:00100000:1.0:1784404643.715489:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404643.715499:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728848000:12345-0@lo:13: 00000100:00100000:2.0:1784404643.716151:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728848256:0@lo:400: 00000100:00100000:2.0:1784404643.716206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404643.716232:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728848768:0@lo:400: 00000100:00100000:2.0:1784404643.716255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404643.716274:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728849280:0@lo:400: 00000100:00100000:2.0:1784404643.716293:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404643.716320:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784404643.716326:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728848384:0@lo:400: 00000100:00100000:2.0:1784404643.716348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404643.716365:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728848896:0@lo:400: 00000100:00100000:2.0:1784404643.716402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404643.716419:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728849408:0@lo:400: 00000100:00100000:2.0:1784404643.716436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404643.716461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848256 00000100:00100000:2.0:1784404643.716465:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848256 00000100:00100000:2.0:1784404643.716491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848768 00000100:00100000:2.0:1784404643.716494:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848768 00000100:00100000:2.0:1784404643.716505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849280 00000100:00100000:2.0:1784404643.716507:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849280 00000100:00100000:2.0:1784404643.716517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848896 00000100:00100000:2.0:1784404643.716519:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848896 00000100:00100000:2.0:1784404643.716530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849408 00000100:00100000:2.0:1784404643.716533:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849408 00000100:00100000:2.0:1784404643.716545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784404643.716552:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728848256:12345-0@lo:400: 00000100:00100000:2.0:1784404643.716604:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728848256:12345-0@lo:400: Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404643.716611:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784404643.716628:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784404643.716634:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728848768:12345-0@lo:400: 00000100:00100000:2.0:1784404643.716657:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728848768:12345-0@lo:400: Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404643.716662:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784404643.716671:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404643.716677:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728849280:12345-0@lo:400: 00000100:00100000:2.0:1784404643.716700:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728849280:12345-0@lo:400: Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404643.716705:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404643.716717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404643.716722:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728848896:12345-0@lo:400: 00000100:00100000:2.0:1784404643.716746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728848896:12345-0@lo:400: Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404643.716751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404643.716761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404643.716767:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728849408:12345-0@lo:400: 00000100:00100000:2.0:1784404643.716792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728849408:12345-0@lo:400: Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404643.716797:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404643.716820:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848384 00000100:00100000:2.0:1784404643.716823:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848384 00000100:00100000:2.0:1784404643.716847:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784404643.716878:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728848384:12345-0@lo:400: 00000100:00100000:2.0:1784404643.716910:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728848384:12345-0@lo:400: Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404643.716915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00002000:00000024:1.0:1784404643.716948:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404643.716955:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728848384:0@lo:400: 00010000:00080000:2.0:1784404643.716967:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e29c00 x1871083728848896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404643.716977:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728848896:0@lo:400: 00000100:00100000:1.0:1784404643.716981:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728848000:12345-0@lo:13: Request processed in 1484us (1662us total) trans 0 rc 0/0 00010000:00080000:2.0:1784404643.716985:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e2a300 x1871083728849408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404643.716987:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784404643.716992:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728849408:0@lo:400: 00000100:00100000:2.0:1784404643.717001:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728848256:0@lo:400: 00000100:00100000:2.0:1784404643.717009:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728848768:0@lo:400: 00000100:00100000:2.0:1784404643.717016:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728849280:0@lo:400: 00000100:00080000:1.0:1784404643.717018:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404643.717022:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404643.717024:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404643.717106:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728848128:0@lo:400: 00000100:00100000:1.0:1784404643.717140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404643.717182:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728848640:0@lo:400: 00000100:00100000:1.0:1784404643.717205:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404643.717220:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728849152:0@lo:400: 00000100:00100000:1.0:1784404643.717240:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404643.717258:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728849664:0@lo:13: 00000100:00100000:1.0:1784404643.717278:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404643.717291:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728848512:0@lo:400: 00000100:00100000:1.0:1784404643.717302:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849664 00000100:00100000:1.0:1784404643.717305:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849664 00000100:00100000:0.0:1784404643.717319:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404643.717332:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784404643.717335:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728849024:0@lo:400: 00000100:00100000:1.0:1784404643.717346:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728849664:12345-0@lo:13: 00000100:00100000:0.0:1784404643.717354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1784404643.717358:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404643.717370:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728849536:0@lo:400: 00000100:00100000:1.0:1784404643.717386:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728849664:12345-0@lo:13: Request processed in 42us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404643.717390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404643.717393:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1784404643.717405:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784404643.717417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea0380 x1871083728848000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1784404643.717419:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd441abf100 x1871083728849664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404643.717431:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728849664:0@lo:13: 00000100:00100000:0.0:1784404643.717431:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728848000:0@lo:13: 00000100:00100000:0.0:1784404643.717449:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849152 00000100:00100000:0.0:1784404643.717452:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849152 00000100:00100000:0.0:1784404643.717482:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849024 00000100:00100000:0.0:1784404643.717485:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849024 00000100:00100000:0.0:1784404643.717513:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849536 00000100:00100000:0.0:1784404643.717516:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849536 00000100:00100000:0.0:1784404643.717534:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784404643.717538:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728849152:12345-0@lo:400: 00000100:00100000:0.0:1784404643.717572:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728849152:12345-0@lo:400: Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404643.717578:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784404643.717589:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784404643.717594:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728849024:12345-0@lo:400: 00000100:00100000:0.0:1784404643.717621:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728849024:12345-0@lo:400: Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404643.717627:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784404643.717636:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784404643.717641:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728849536:12345-0@lo:400: 00000100:00100000:0.0:1784404643.717664:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728849536:12345-0@lo:400: Request processed in 22us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404643.717669:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1784404643.717685:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404643.717687:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784404643.717701:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e2a680 x1871083728849152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404643.717710:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728849152:0@lo:400: 00010000:00080000:0.0:1784404643.717729:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e28e00 x1871083728849024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404643.717737:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728849024:0@lo:400: 00010000:00080000:0.0:1784404643.717746:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e28700 x1871083728849536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404643.717761:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728849536:0@lo:400: 00000100:00100000:2.0:1784404643.727043:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848128 00000100:00100000:2.0:1784404643.727059:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848128 00000100:00100000:2.0:1784404643.727193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1784404643.727206:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728848128:12345-0@lo:400: 00000100:00100000:2.0:1784404643.727326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728848128:12345-0@lo:400: Request processed in 123us (10184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404643.727334:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1784404643.727390:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728849920:0@lo:13: 00000100:00100000:1.0:1784404643.727414:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728848128:0@lo:400: 00000100:00100000:2.0:1784404643.727423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404643.727503:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404643.727511:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728849792:0@lo:13: 00000100:00100000:2.0:1784404643.727533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404643.733362:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848640 00000100:00100000:0.0:1784404643.733378:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848640 00000100:00100000:0.0:1784404643.733445:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784404643.733456:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728848640:12345-0@lo:400: 00000100:00100000:0.0:1784404643.733547:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728848640:12345-0@lo:400: Request processed in 93us (16340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404643.733555:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784404643.733579:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728848512 00000100:00100000:0.0:1784404643.733583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728848512 00000100:00100000:0.0:1784404643.733611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784404643.733616:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728848512:12345-0@lo:400: 00000100:00100000:0.0:1784404643.733652:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728848512:12345-0@lo:400: Request processed in 36us (16332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404643.733657:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784404643.733697:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728848512:0@lo:400: 00000100:00100000:1.0:1784404643.737332:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728848640:0@lo:400: 00000100:00100000:3.0:1784404643.745298:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849920 00000100:00100000:3.0:1784404643.745316:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849920 00000100:00100000:3.0:1784404643.745398:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728849792 00000100:00100000:3.0:1784404643.745402:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728849792 00000100:00100000:3.0:1784404643.745424:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784404643.745433:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728849920:12345-0@lo:13: 00002000:00000024:3.0:1784404643.745466:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404643.745560:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728849920:12345-0@lo:13: Request processed in 128us (18135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404643.745567:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784404643.745584:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784404643.745590:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728849792:12345-0@lo:13: 00002000:00000024:3.0:1784404643.745601:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404643.745630:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728849792:12345-0@lo:13: Request processed in 40us (18095us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404643.745636:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1784404643.745683:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd441abdc00 x1871083728849792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404643.745705:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728849792:0@lo:13: 00010000:00080000:3.0:1784404643.745718:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd441abce00 x1871083728849920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404643.745730:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728849920:0@lo:13: 00010000:00010000:0.0:1784404644.099141:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784404644.228770:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000001:00100000:2.0:1784404644.236771:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000001:00100000:2.0:1784404644.237797:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000001:02000400:2.0:1784404645.003470:0:10182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1784404645.084518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404645.084570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404645.084605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404645.084627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404645.084666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404645.084711:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830784 00000100:00100000:1.0:1784404645.084721:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830784 00000100:00100000:1.0:1784404645.084777:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830656 00000100:00100000:1.0:1784404645.084780:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830656 00000100:00100000:1.0:1784404645.084804:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784404645.084814:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707830784:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1784404645.084936:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707830784:12345-192.168.202.42@tcp:400: Request processed in 123us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404645.084937:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830528 00000100:00100000:1.0:1784404645.084946:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:3.0:1784404645.084947:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830528 00000100:00100000:1.0:1784404645.084964:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1784404645.084975:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707830656:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1784404645.085013:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707830656:12345-192.168.202.42@tcp:400: Request processed in 38us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404645.085019:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1784404645.085037:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830400 00000100:00100000:1.0:1784404645.085040:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830400 00000100:00100000:3.0:1784404645.085065:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:3.0:1784404645.085072:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707830528:12345-192.168.202.42@tcp:400: 00000100:00100000:3.0:1784404645.085108:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707830528:12345-192.168.202.42@tcp:400: Request processed in 37us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404645.085125:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830272 00000100:00100000:2.0:1784404645.085129:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830272 00000100:00100000:2.0:1784404645.085171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:2.0:1784404645.085179:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2404:x1871083707830272:12345-192.168.202.42@tcp:400: 00000100:00100000:2.0:1784404645.085206:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2404:x1871083707830272:12345-192.168.202.42@tcp:400: Request processed in 28us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404645.085212:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00080000:0.0:1784404645.086707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404645.086714:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404645.086718:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404645.086720:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404645.087486:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:1.0:1784404645.087507:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707830400:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1784404645.087586:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707830400:12345-192.168.202.42@tcp:400: Request processed in 89us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404645.087594:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1784404645.087767:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00010000:00010000:2.0:1784404645.127016:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404645.251134:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404645.251187:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728850048:0@lo:41: 00000100:00100000:1.0:1784404645.251265:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404645.251391:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728850048 00000100:00100000:0.0:1784404645.251399:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728850048 00000100:00100000:0.0:1784404645.251460:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784404645.251472:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728850048:12345-0@lo:41: 00000004:00000024:0.0:1784404645.251535:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404645.251588:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728850048:12345-0@lo:41: Request processed in 119us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404645.251594:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784404645.252024:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728850048:0@lo:41: 00000001:00100000:1.0:1784404645.255234:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00010000:00010000:2.0:1784404646.148263:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404646.277915:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728850176:0@lo:41: 00000100:00100000:0.0:1784404646.277990:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404646.278187:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728850176 00000100:00100000:3.0:1784404646.278196:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728850176 00000100:00100000:3.0:1784404646.278257:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784404646.278268:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728850176:12345-0@lo:41: 00000004:00000024:3.0:1784404646.278302:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784404646.278348:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728850176:12345-0@lo:41: Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404646.278356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784404646.278434:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728850176:0@lo:41: 00010000:00010000:0.0:1784404647.171287:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404648.195595:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784404648.790403:0:10330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb19eb880 20000000:00000080:2.0:1784404648.790422:0:10330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd442596400 uarg=0000000000000000 20000000:01000000:2.0:1784404648.790473:0:10330:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1784404648.790475:0:10330:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1784404648.790478:0:10330:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1784404648.790483:0:10330:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1784404648.790488:0:10330:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1784404648.790591:0:10330:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784404648.790594:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784404648.791364:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1784404648.791766:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1784404648.791800:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1784404648.791816:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1784404648.791829:0:10330:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1784404648.791831:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784404648.792221:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1784404648.792370:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1784404648.792391:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1784404648.792404:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1784404648.792413:0:10330:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784404648.792421:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784404648.792736:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1784404648.793163:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1784404648.793193:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1784404648.793212:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1784404648.793223:0:10330:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784404648.793225:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784404648.793523:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1784404648.793668:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1784404648.793689:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1784404648.793704:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1784404648.793715:0:10330:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784404648.793716:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784404648.795019:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1784404648.797407:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1784404648.797442:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1784404648.797455:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1784404648.797472:0:10330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784404648.797491:0:10330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797509:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797517:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797546:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797553:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797560:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797568:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797575:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797581:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797587:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797595:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797602:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797609:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797661:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797677:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 9 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.797703:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850304:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404648.797886:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797896:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 9 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.797905:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850432:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404648.797938:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.797947:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.797956:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850560:0@lo:104: 00000100:00100000:0.0:1784404648.797996:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404648.798031:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798040:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798059:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850688:0@lo:104: 00000100:00100000:0.0:1784404648.798081:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404648.798112:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798121:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798138:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850816:0@lo:104: 00000100:00100000:0.0:1784404648.798158:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404648.798173:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798180:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798188:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850944:0@lo:104: 00000100:00100000:0.0:1784404648.798210:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404648.798226:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798234:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798242:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851072:0@lo:104: 00010000:00010000:0.0:1784404648.798289:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798305:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798312:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851200:0@lo:104: 00010000:00010000:0.0:1784404648.798337:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798344:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798351:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851328:0@lo:104: 00010000:00010000:0.0:1784404648.798371:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798378:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798385:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851456:0@lo:104: 00010000:00010000:0.0:1784404648.798404:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.798411:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 23 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.798418:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851584:0@lo:104: 00000100:00100000:0.0:1784404648.798435:0:10330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404648.798559:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784404648.798578:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.798591:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.798599:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.798607:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.798616:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.798624:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728850560 00000100:00100000:1.0:1784404648.798631:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728850560 00000100:00100000:1.0:1784404648.798672:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728850688 00000100:00100000:1.0:1784404648.798675:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728850688 00000100:00100000:1.0:1784404648.798684:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728850816 00000100:00100000:1.0:1784404648.798687:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728850816 00000100:00100000:1.0:1784404648.798707:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728850944 00000100:00100000:1.0:1784404648.798710:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728850944 00000100:00100000:1.0:1784404648.798719:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851072 00000100:00100000:1.0:1784404648.798722:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851072 00000100:00100000:1.0:1784404648.798730:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851200 00000100:00100000:1.0:1784404648.798732:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851200 00000100:00100000:1.0:1784404648.798740:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851328 00000100:00100000:1.0:1784404648.798742:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851328 00000100:00100000:1.0:1784404648.798750:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851456 00000100:00100000:1.0:1784404648.798752:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851456 00000100:00100000:1.0:1784404648.798760:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851584 00000100:00100000:1.0:1784404648.798762:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851584 00000100:00100000:1.0:1784404648.798775:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404648.798782:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:10330:x1871083728850560:12345-0@lo:104: 00010000:00010000:1.0:1784404648.798795:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.798869:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784404648.798875:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+11:10330:x1871083728850560:12345-0@lo:104: Request processed in 93us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.798881:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404648.798901:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404648.798907:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:10330:x1871083728850688:12345-0@lo:104: 00010000:00010000:1.0:1784404648.798914:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.798943:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784404648.798947:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+10:10330:x1871083728850688:12345-0@lo:104: Request processed in 41us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.798953:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404648.798973:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404648.798978:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:10330:x1871083728850816:12345-0@lo:104: 00010000:00010000:1.0:1784404648.798986:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799011:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784404648.799015:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+9:10330:x1871083728850816:12345-0@lo:104: Request processed in 38us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.799021:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404648.799032:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404648.799037:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44273c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+8:10330:x1871083728850944:12345-0@lo:104: 00010000:00010000:1.0:1784404648.799043:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799067:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784404648.799072:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44273c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+8:10330:x1871083728850944:12345-0@lo:104: Request processed in 35us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.799077:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404648.799111:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784404648.799117:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+7:10330:x1871083728851072:12345-0@lo:104: 00010000:00010000:1.0:1784404648.799124:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799161:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1784404648.799166:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+7:10330:x1871083728851072:12345-0@lo:104: Request processed in 51us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.799172:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784404648.799192:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784404648.799198:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:10330:x1871083728851200:12345-0@lo:104: 00010000:00010000:1.0:1784404648.799205:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799230:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1784404648.799234:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:10330:x1871083728851200:12345-0@lo:104: Request processed in 38us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.799239:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784404648.799250:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404648.799255:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:10330:x1871083728851328:12345-0@lo:104: 00010000:00010000:1.0:1784404648.799261:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799283:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1784404648.799288:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:10330:x1871083728851328:12345-0@lo:104: Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.799293:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404648.799304:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404648.799309:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:10330:x1871083728851456:12345-0@lo:104: 00010000:00010000:1.0:1784404648.799317:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799338:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1784404648.799342:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:10330:x1871083728851456:12345-0@lo:104: Request processed in 33us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.799346:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404648.799363:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784404648.799368:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:10330:x1871083728851584:12345-0@lo:104: 00010000:00010000:1.0:1784404648.799375:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799401:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1784404648.799406:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:10330:x1871083728851584:12345-0@lo:104: Request processed in 39us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.799412:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1784404648.799432:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1784404648.799438:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799446:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.799451:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799459:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.799466:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.799472:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.799508:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799514:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.799534:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799551:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541391a00/0x24b3e2e6dcd78d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78d26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799566:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1784404648.799569:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799576:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821db600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.799579:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799586:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.799593:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.799598:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.799610:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799615:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.799620:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799627:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821db600/0x24b3e2e6dcd78cf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78cfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799637:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1784404648.799645:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799651:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.799654:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799661:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.799667:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.799673:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.799684:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799690:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.799704:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799710:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541390a00/0x24b3e2e6dcd78cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ce0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799719:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784404648.799722:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799727:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.799730:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799747:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.799753:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.799758:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.799770:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799776:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.799781:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799787:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d209800/0x24b3e2e6dcd78caf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78cb6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799796:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784404648.799799:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799805:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dba00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.799807:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799813:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.799818:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.799828:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.799839:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799845:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.799874:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799882:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd78c93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799891:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784404648.799894:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799899:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.799903:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799909:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.799915:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.799920:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.799931:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799936:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.799946:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799952:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d209a00/0x24b3e2e6dcd78c85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799961:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784404648.799964:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799970:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.799973:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.799980:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.799987:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.799993:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.800003:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800009:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.800013:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800020:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78c77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800028:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784404648.800036:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800042:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821daa00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.800044:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800051:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.800056:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.800061:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.800074:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800080:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.800084:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800090:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78c38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c3f expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800101:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404648.800103:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800110:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404648.800112:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800143:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404648.800150:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404648.800155:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404648.800167:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800173:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404648.800177:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800183:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c15 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800195:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404648.800197:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404648.800198:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404648.800207:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404648.800220:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728851712:0@lo:103: 00000100:00100000:1.0:1784404648.800261:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800299:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728852224:0@lo:103: 00000100:00100000:1.0:1784404648.800320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800335:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728852736:0@lo:103: 00000100:00100000:1.0:1784404648.800369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800392:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784404648.800403:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728851840:0@lo:103: 00000100:00100000:1.0:1784404648.800424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800432:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728852352:0@lo:103: 00000100:00100000:1.0:1784404648.800448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800465:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728851968:0@lo:103: 00000100:00100000:1.0:1784404648.800483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800492:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728852480:0@lo:103: 00000100:00100000:1.0:1784404648.800508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800518:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784404648.800523:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728852096:0@lo:103: 00000100:00100000:1.0:1784404648.800542:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800549:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728852608:0@lo:103: 00000100:00100000:1.0:1784404648.800564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404648.800588:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851712 00000100:00100000:1.0:1784404648.800594:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851712 00010000:00010000:1.0:1784404648.800620:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 24 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800637:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852224 00000100:00100000:1.0:1784404648.800640:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852224 00010000:00010000:1.0:1784404648.800649:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 25 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800660:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852736 00000100:00100000:1.0:1784404648.800662:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852736 00010000:00010000:1.0:1784404648.800671:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 26 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800680:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851840 00000100:00100000:1.0:1784404648.800702:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851840 00010000:00010000:1.0:1784404648.800714:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 27 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800726:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852352 00000100:00100000:1.0:1784404648.800729:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852352 00010000:00010000:1.0:1784404648.800737:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 28 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800746:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728851968 00000100:00100000:1.0:1784404648.800748:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728851968 00010000:00010000:1.0:1784404648.800756:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 29 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800764:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852480 00000100:00100000:1.0:1784404648.800766:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852480 00010000:00010000:1.0:1784404648.800774:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 30 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800782:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852096 00000100:00100000:1.0:1784404648.800784:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852096 00010000:00010000:1.0:1784404648.800792:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 31 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800800:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852608 00000100:00100000:1.0:1784404648.800802:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852608 00010000:00010000:1.0:1784404648.800810:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 32 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.800821:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404648.800827:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+32:3646:x1871083728851712:12345-0@lo:103: 00010000:00010000:1.0:1784404648.800839:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.800870:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 32 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800883:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 32 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.800901:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.800934:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+32:3646:x1871083728851712:12345-0@lo:103: Request processed in 106us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.800942:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404648.800983:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404648.800988:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+31:3646:x1871083728852224:12345-0@lo:103: 00010000:00010000:1.0:1784404648.800994:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.800999:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 31 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801007:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 31 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801015:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801035:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+31:3646:x1871083728852224:12345-0@lo:103: Request processed in 47us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801041:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404648.801053:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404648.801058:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+30:3646:x1871083728852736:12345-0@lo:103: 00010000:00010000:1.0:1784404648.801065:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.801068:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 30 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801086:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 30 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801096:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801118:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+30:3646:x1871083728852736:12345-0@lo:103: Request processed in 60us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801124:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404648.801147:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404648.801152:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+29:3646:x1871083728851840:12345-0@lo:103: 00010000:00010000:1.0:1784404648.801160:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.801164:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 29 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801171:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 29 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801179:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801199:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+29:3646:x1871083728851840:12345-0@lo:103: Request processed in 47us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801205:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404648.801215:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784404648.801221:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+28:3646:x1871083728852352:12345-0@lo:103: 00010000:00010000:1.0:1784404648.801228:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.801232:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 28 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801241:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 28 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801254:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801274:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+28:3646:x1871083728852352:12345-0@lo:103: Request processed in 53us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801281:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784404648.801292:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784404648.801297:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+27:3648:x1871083728851968:12345-0@lo:103: 00010000:00010000:1.0:1784404648.801303:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.801308:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 27 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801316:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 27 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801323:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801346:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+27:3648:x1871083728851968:12345-0@lo:103: Request processed in 49us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801352:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784404648.801363:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404648.801368:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+26:3648:x1871083728852480:12345-0@lo:103: 00010000:00010000:1.0:1784404648.801375:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.801380:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 26 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801387:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 26 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801396:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801421:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+26:3648:x1871083728852480:12345-0@lo:103: Request processed in 53us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801428:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404648.801439:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404648.801444:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+25:3648:x1871083728852096:12345-0@lo:103: 00010000:00010000:1.0:1784404648.801451:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.801454:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 25 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801462:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 25 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801471:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801488:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+25:3648:x1871083728852096:12345-0@lo:103: Request processed in 44us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801494:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404648.801517:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784404648.801522:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728852608:12345-0@lo:103: 00010000:00010000:1.0:1784404648.801529:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404648.801533:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 24 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801541:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 24 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.801550:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404648.801568:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728852608:12345-0@lo:103: Request processed in 45us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404648.801573:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784404648.801627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728852096:0@lo:103: 00000100:00100000:1.0:1784404648.801635:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728852608:0@lo:103: 00000100:00100000:1.0:1784404648.801642:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728851968:0@lo:103: 00000100:00100000:1.0:1784404648.801649:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728852480:0@lo:103: 00000100:00100000:1.0:1784404648.801678:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728851840:0@lo:103: 00000100:00100000:1.0:1784404648.801685:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728852352:0@lo:103: 00000100:00100000:1.0:1784404648.801692:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728851712:0@lo:103: 00000100:00100000:1.0:1784404648.801698:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728852224:0@lo:103: 00000100:00100000:1.0:1784404648.801704:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728852736:0@lo:103: 00010000:00010000:0.0:1784404648.802116:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78d1f expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802158:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850560:0@lo:104: 00010000:00010000:0.0:1784404648.802173:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78cfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cf5 expref: 22 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802180:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850688:0@lo:104: 00010000:00010000:0.0:1784404648.802188:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd78ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78cd9 expref: 21 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802197:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850816:0@lo:104: 00010000:00010000:0.0:1784404648.802205:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78cb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78caf expref: 20 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802216:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850944:0@lo:104: 00010000:00010000:0.0:1784404648.802225:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78c9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c93 expref: 19 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802233:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851072:0@lo:104: 00010000:00010000:0.0:1784404648.802242:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d209000/0x24b3e2e6dcd78c8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c85 expref: 18 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802250:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851200:0@lo:104: 00010000:00010000:0.0:1784404648.802258:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d208200/0x24b3e2e6dcd78c7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c77 expref: 17 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802266:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851328:0@lo:104: 00010000:00010000:0.0:1784404648.802277:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd78c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c38 expref: 16 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802291:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851456:0@lo:104: 00010000:00010000:0.0:1784404648.802302:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd78c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c0e expref: 15 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.802309:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728851584:0@lo:104: 00000100:00100000:1.0:1784404648.807432:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850304:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404648.807448:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1871083728850432:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404648.807494:0:10330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.809123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404648.809260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404648.809442:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707830912 00000100:00100000:1.0:1784404648.809453:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707830912 00010000:00010000:1.0:1784404648.809495:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 10 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404648.809631:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831040 00000100:00100000:1.0:1784404648.809635:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831040 00010000:00010000:1.0:1784404648.809648:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 11 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404648.809798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:0.0:1784404648.809812:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:2403:x1871083707830912:12345-192.168.202.42@tcp:103: 00010000:00010000:0.0:1784404648.809831:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404648.809837:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 11 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404648.809948:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1784404648.809959:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1784404648.810189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1784404648.810200:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:2403:x1871083707831040:12345-192.168.202.42@tcp:103: 00010000:00010000:3.0:1784404648.810209:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404648.810214:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 11 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.810259:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 11 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404648.810425:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 11 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404648.810443:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7054 expref: 11 pid: 6514 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404648.810458:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404648.810517:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707831040:12345-192.168.202.42@tcp:103: Request processed in 319us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404648.810524:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00010000:00010000:0.0:1784404648.810820:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54167e400/0x24b3e2e6dcd78d3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed705b expref: 9 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.810836:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.810846:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.810970:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.810988:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.810995:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.811003:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.811009:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151bc00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404648.811014:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.811023:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.811034:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404648.811044:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404648.811109:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:2403:x1871083707830912:12345-192.168.202.42@tcp:103: Request processed in 1300us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.811117:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00010000:00010000:1.0:1784404648.811191:0:10330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.811200:0:10330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404648.811207:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78d7a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404648.835007:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404648.835035:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728852864:0@lo:13: 00000100:00100000:3.0:1784404648.835141:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404648.835211:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852864 00000100:00100000:3.0:1784404648.835218:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852864 00000100:00100000:3.0:1784404648.835278:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784404648.835287:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728852864:12345-0@lo:13: 00002000:00000024:3.0:1784404648.835317:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404648.835360:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728852864:12345-0@lo:13: Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404648.835367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1784404648.835437:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362d880 x1871083728852864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404648.835454:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728852864:0@lo:13: 00000100:00080000:0.0:1784404648.835587:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404648.835611:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728852992:0@lo:13: 00000100:00100000:0.0:1784404648.835640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404648.835671:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728852992 00000100:00100000:0.0:1784404648.835675:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728852992 00000100:00100000:0.0:1784404648.835715:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784404648.835732:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728852992:12345-0@lo:13: 00002000:00000024:0.0:1784404648.835748:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404648.835781:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728852992:12345-0@lo:13: Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.835787:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1784404648.835813:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784404648.835828:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442555f80 x1871083728852992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404648.835840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728852992:0@lo:13: 00000100:00100000:2.0:1784404648.836298:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728853120:0@lo:13: 00000100:00100000:2.0:1784404648.836334:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404648.836398:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728853120 00000100:00100000:3.0:1784404648.836403:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728853120 00000100:00100000:3.0:1784404648.836454:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784404648.836460:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728853120:12345-0@lo:13: 00002000:00000024:3.0:1784404648.836473:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404648.836508:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728853120:12345-0@lo:13: Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404648.836515:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1784404648.836542:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362d880 x1871083728853120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404648.836555:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728853120:0@lo:13: 00000100:00080000:2.0:1784404648.836598:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404648.836756:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728853504:0@lo:400: 00000100:00100000:0.0:1784404648.836819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404648.836841:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728854016:0@lo:400: 00000100:00100000:0.0:1784404648.836890:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404648.836912:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784404648.836918:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728853632:0@lo:400: 00000100:00100000:0.0:1784404648.836941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404648.836961:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728854144:0@lo:400: 00000100:00100000:0.0:1784404648.836982:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404648.837014:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728853504 00000100:00100000:0.0:1784404648.837018:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728853504 00000100:00100000:0.0:1784404648.837053:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854144 00000100:00100000:0.0:1784404648.837056:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854144 00000100:00100000:0.0:1784404648.837084:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784404648.837092:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728853504:12345-0@lo:400: 00000100:00100000:0.0:1784404648.837151:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728853504:12345-0@lo:400: Request processed in 60us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.837167:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784404648.837182:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784404648.837188:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728854144:12345-0@lo:400: 00000100:00100000:0.0:1784404648.837217:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728854144:12345-0@lo:400: Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.837222:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784404648.837240:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854016 00000100:00100000:0.0:1784404648.837244:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854016 00000100:00100000:0.0:1784404648.837271:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784404648.837278:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728854016:12345-0@lo:400: 00000100:00100000:0.0:1784404648.837308:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728854016:12345-0@lo:400: Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.837315:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784404648.837331:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728853632 00000100:00100000:0.0:1784404648.837334:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728853632 00000100:00100000:0.0:1784404648.837357:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784404648.837363:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728853632:12345-0@lo:400: 00000100:00100000:0.0:1784404648.837395:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728853632:12345-0@lo:400: Request processed in 32us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.837401:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1784404648.837437:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404648.837441:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404648.837468:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728853632:0@lo:400: 00000100:00100000:0.0:1784404648.837478:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728854144:0@lo:400: 00000100:00100000:0.0:1784404648.837487:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728853504:0@lo:400: 00010000:00080000:0.0:1784404648.837510:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443633480 x1871083728854016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404648.837520:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728854016:0@lo:400: 00000100:00100000:2.0:1784404648.837680:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728853376:0@lo:400: 00000100:00100000:2.0:1784404648.837722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404648.837748:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728853888:0@lo:400: 00000100:00100000:2.0:1784404648.837769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404648.837785:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784404648.837791:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728853248:0@lo:400: 00000100:00100000:2.0:1784404648.837829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404648.837844:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728853760:0@lo:400: 00000100:00100000:2.0:1784404648.837879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404648.837894:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728854272:0@lo:400: 00000100:00100000:2.0:1784404648.837915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404648.838873:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728854400:0@lo:13: 00000100:00100000:3.0:1784404648.838916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404648.839006:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854400 00000100:00100000:2.0:1784404648.839013:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854400 00000100:00100000:2.0:1784404648.839069:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784404648.839079:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728854400:12345-0@lo:13: 00002000:00000024:2.0:1784404648.839102:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404648.839158:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728854400:12345-0@lo:13: Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404648.839164:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1784404648.839234:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e28380 x1871083728854400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404648.839252:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728854400:0@lo:13: 00000100:00100000:0.0:1784404648.840086:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728853888 00000100:00100000:0.0:1784404648.840095:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728853888 00000100:00100000:0.0:1784404648.840152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728853248 00000100:00100000:0.0:1784404648.840156:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728853248 00000100:00100000:0.0:1784404648.840169:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728853760 00000100:00100000:0.0:1784404648.840172:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728853760 00000100:00100000:0.0:1784404648.840186:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854272 00000100:00100000:0.0:1784404648.840189:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854272 00000100:00100000:0.0:1784404648.840205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784404648.840214:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728853888:12345-0@lo:400: 00000100:00100000:0.0:1784404648.840292:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728853888:12345-0@lo:400: Request processed in 79us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.840299:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784404648.840316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784404648.840323:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728853248:12345-0@lo:400: 00000100:00100000:0.0:1784404648.840372:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728853248:12345-0@lo:400: Request processed in 49us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.840378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784404648.840390:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784404648.840396:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728853760:12345-0@lo:400: 00000100:00100000:0.0:1784404648.840422:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728853760:12345-0@lo:400: Request processed in 27us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.840428:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784404648.840438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784404648.840451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728854272:12345-0@lo:400: 00000100:00100000:0.0:1784404648.840477:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728854272:12345-0@lo:400: Request processed in 27us (2561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.840482:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784404648.840509:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728853376 00000100:00100000:0.0:1784404648.840512:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728853376 00000100:00100000:0.0:1784404648.840537:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784404648.840543:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728853376:12345-0@lo:400: 00000100:00100000:0.0:1784404648.840578:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728853376:12345-0@lo:400: Request processed in 35us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404648.840584:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784404648.840625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728853248:0@lo:400: 00000100:00100000:0.0:1784404648.840637:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728853760:0@lo:400: 00010000:00080000:0.0:1784404648.840651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443633100 x1871083728854272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404648.840663:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728854272:0@lo:400: 00000100:00100000:0.0:1784404648.840675:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728853376:0@lo:400: 00010000:00080000:0.0:1784404648.840685:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9b800 x1871083728853888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404648.840694:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728853888:0@lo:400: 00000100:00080000:1.0:1784404648.840784:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404648.840792:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784404649.219464:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784404649.987079:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784404649.987095:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd442280800 from 48 10000000:01000000:3.0:1784404649.987104:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784404649.987189:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404649.987206:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404649.987218:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404649.987292:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728854528:0@lo:101: 00000100:00100000:3.0:1784404649.987448:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404649.987563:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442533d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784404649.987620:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854528 00000100:00100000:2.0:1784404649.987635:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854528 00000100:00100000:2.0:1784404649.987717:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784404649.987727:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+15:6517:x1871083728854528:12345-0@lo:101: 00010000:00010000:2.0:1784404649.987743:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404649.987760:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541390a00/0x24b3e2e6dcd78d88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78d81 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404649.987788:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541390a00/0x24b3e2e6dcd78d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d81 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404649.987799:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541390a00/0x24b3e2e6dcd78d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d81 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404649.987809:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541390a00, rc 0) 00000100:00100000:2.0:1784404649.987900:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728854528:12345-0@lo:101: Request processed in 175us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404649.987908:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784404649.988139:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728854528:0@lo:101: 00010000:00010000:0.0:1784404649.988156:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404649.988177:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404649.988263:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728854656:0@lo:501: 00000100:00100000:0.0:1784404649.988292:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404649.988334:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78600 going to sleep for 11 seconds 00000100:00100000:3.0:1784404649.988397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854656 00000100:00100000:3.0:1784404649.988402:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854656 00000100:00100000:3.0:1784404649.988547:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784404649.988557:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728854656:12345-0@lo:501: 00000100:00100000:3.0:1784404649.989203:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728854656:12345-0@lo:501: Request processed in 647us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404649.989212:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784404649.994040:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728854656:0@lo:501: 00000100:00100000:0.0:1784404649.994111:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728854784:0@lo:503: 00000100:00100000:0.0:1784404649.994203:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404649.994254:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78600 going to sleep for 11 seconds 00000100:00100000:2.0:1784404649.994281:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854784 00000100:00100000:2.0:1784404649.994288:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854784 00000100:00100000:2.0:1784404649.994352:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1784404649.994362:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728854784:12345-0@lo:503: 00000100:00100000:2.0:1784404649.994543:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728854784:12345-0@lo:503: Request processed in 183us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404649.994551:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784404649.994870:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728854784:0@lo:503: 00000100:00100000:3.0:1784404649.995353:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10348:1871083728854912:0@lo:502: 00000100:00100000:3.0:1784404649.995401:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404649.995435:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4425336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404649.996270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728854912 00000100:00100000:2.0:1784404649.996279:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728854912 00000100:00100000:2.0:1784404649.996341:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784404649.996351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:10348:x1871083728854912:12345-0@lo:502: 00000100:00100000:2.0:1784404649.996517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:10348:x1871083728854912:12345-0@lo:502: Request processed in 167us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404649.996530:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1784404649.996700:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10348:1871083728854912:0@lo:502: 00000100:00100000:3.0:1784404649.996763:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10348:1871083728855040:0@lo:502: 00000100:00100000:3.0:1784404649.996799:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404649.996833:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4425336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404649.996965:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855040 00000100:00100000:1.0:1784404649.996970:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855040 00000100:00100000:1.0:1784404649.997012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784404649.997020:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:10348:x1871083728855040:12345-0@lo:502: 00000100:00100000:1.0:1784404649.997114:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:10348:x1871083728855040:12345-0@lo:502: Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404649.997131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784404649.997370:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10348:1871083728855040:0@lo:502: 00000040:00080000:3.0:1784404649.997392:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784404649.999640:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784404649.999699:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404649.999713:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404649.999726:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404649.999736:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784404649.999755:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1784404649.999758:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784404649.999800:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404649.999808:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404649.999819:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404649.999846:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855168:0@lo:101: 00000100:00100000:1.0:1784404649.999968:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.000024:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.000539:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855168 00000100:00100000:3.0:1784404650.000549:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855168 00000100:00100000:3.0:1784404650.000597:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784404650.000606:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+16:6517:x1871083728855168:12345-0@lo:101: 00010000:00010000:3.0:1784404650.000618:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404650.000631:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78d8f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.000664:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d8f expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.000674:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d8f expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.000693:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821da400, rc 0) 00000100:00100000:3.0:1784404650.000740:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728855168:12345-0@lo:101: Request processed in 135us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.000747:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784404650.001477:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855168:0@lo:101: 00010000:00010000:1.0:1784404650.001495:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.001505:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404650.001569:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855296:0@lo:501: 00000100:00100000:1.0:1784404650.001600:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.001631:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.001797:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855296 00000100:00100000:2.0:1784404650.001803:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855296 00000100:00100000:2.0:1784404650.001844:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784404650.001884:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728855296:12345-0@lo:501: 00000100:00100000:2.0:1784404650.002065:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728855296:12345-0@lo:501: Request processed in 214us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.002072:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784404650.002292:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855296:0@lo:501: 00000100:00100000:1.0:1784404650.002320:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855424:0@lo:503: 00000100:00100000:1.0:1784404650.002365:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.002392:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404650.002499:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855424 00000100:00100000:0.0:1784404650.002504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855424 00000100:00100000:0.0:1784404650.002533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784404650.002539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728855424:12345-0@lo:503: 00000100:00100000:0.0:1784404650.002613:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728855424:12345-0@lo:503: Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.002619:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784404650.003558:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855424:0@lo:503: 00000100:00100000:0.0:1784404650.006554:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10349:1871083728855552:0@lo:502: 00000100:00100000:0.0:1784404650.006648:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.006799:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.006912:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855552 00000100:00100000:3.0:1784404650.006919:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855552 00000100:00100000:3.0:1784404650.007076:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1784404650.007088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:10349:x1871083728855552:12345-0@lo:502: 00000100:00100000:3.0:1784404650.007292:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:10349:x1871083728855552:12345-0@lo:502: Request processed in 206us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.007299:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1784404650.007399:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10349:1871083728855552:0@lo:502: 00000020:01000000:1.0:1784404650.007442:0:10349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404650.007451:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404650.007454:0:10349:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784404650.007459:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784404650.007485:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10349:1871083728855680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.007523:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.007779:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404650.007912:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855680 00000100:00100000:0.0:1784404650.007918:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855680 00000100:00100000:0.0:1784404650.007947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784404650.007954:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:10349:x1871083728855680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404650.008064:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:10349:x1871083728855680:12345-0@lo:502:llog_process_th.0 Request processed in 109us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.008076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1784404650.008254:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10349:1871083728855680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784404650.008283:0:10349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404650.008288:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404650.008290:0:10349:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784404650.008293:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1784404650.008541:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1784404650.008561:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784404650.008570:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.008581:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404650.008593:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784404650.008595:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd574d3a800 from 48 10000000:01000000:0.0:1784404650.008599:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784404650.008625:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.008633:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.008641:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404650.008658:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.012886:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.012945:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78180 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.013086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855808 00000100:00100000:1.0:1784404650.013095:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855808 00000100:00100000:1.0:1784404650.013157:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784404650.013167:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+17:6517:x1871083728855808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404650.013186:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404650.013207:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549000/0x24b3e2e6dcd78da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78d9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.013236:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549000/0x24b3e2e6dcd78da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d9d expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.013248:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549000/0x24b3e2e6dcd78da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d9d expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.013275:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549000, rc 0) 00000100:00100000:1.0:1784404650.013355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728855808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.013362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784404650.013760:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404650.013782:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.013804:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404650.014355:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.014410:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.014557:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78180 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.016127:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728855936 00000100:00100000:2.0:1784404650.016140:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728855936 00000100:00100000:1.0:1784404650.027895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784404650.028144:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728855936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.028386:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728855936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 472us (13974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.028394:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784404650.028561:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728855936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.028631:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.028711:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.028749:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78180 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.029164:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856064 00000100:00100000:3.0:1784404650.029173:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856064 00000100:00100000:3.0:1784404650.029210:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1784404650.029219:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728856064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.029317:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728856064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.029323:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784404650.031610:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.032523:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10350:1871083728856192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404650.032603:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404650.032643:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.032793:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856192 00000100:00100000:3.0:1784404650.032800:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856192 00000100:00100000:3.0:1784404650.032878:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784404650.032890:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:10350:x1871083728856192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.034206:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:10350:x1871083728856192:12345-0@lo:502:llog_process_th.0 Request processed in 1311us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.034216:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784404650.035497:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10350:1871083728856192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404650.035585:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10350:1871083728856320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404650.035647:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404650.035689:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.035906:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856320 00000100:00100000:3.0:1784404650.035913:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856320 00000100:00100000:3.0:1784404650.035974:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784404650.035994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:10350:x1871083728856320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.036160:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:10350:x1871083728856320:12345-0@lo:502:llog_process_th.0 Request processed in 167us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.036167:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1784404650.036354:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10350:1871083728856320:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784404650.036379:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784404650.037287:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1784404650.037313:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784404650.037324:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.037336:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404650.037347:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784404650.037350:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1784404650.037353:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784404650.037387:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.037395:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.037429:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404650.037453:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.037497:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.037524:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442533780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404650.040223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856448 00000100:00100000:0.0:1784404650.040247:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856448 00000100:00100000:0.0:1784404650.040350:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784404650.040363:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+18:6517:x1871083728856448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404650.040390:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404650.040433:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78dab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.040475:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dab expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.040490:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dab expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.040527:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b800, rc 0) 00000100:00100000:0.0:1784404650.040654:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728856448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.040663:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784404650.040905:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404650.040927:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.040948:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404650.041039:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.041079:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.041110:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404650.041185:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856576 00000100:00100000:0.0:1784404650.041190:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856576 00000100:00100000:0.0:1784404650.041263:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784404650.041273:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728856576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.041455:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728856576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.041463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1784404650.041535:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.041566:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.041612:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404650.041992:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.042128:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856704 00000100:00100000:1.0:1784404650.042137:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856704 00000100:00100000:1.0:1784404650.042166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784404650.042173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728856704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.042295:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728856704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.042303:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784404650.042461:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728856704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.043077:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10351:1871083728856832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404650.043147:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404650.043184:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.043532:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856832 00000100:00100000:1.0:1784404650.043538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856832 00000100:00100000:1.0:1784404650.043568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1784404650.043575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:10351:x1871083728856832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.043787:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:10351:x1871083728856832:12345-0@lo:502:llog_process_th.0 Request processed in 211us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.043795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1784404650.046300:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10351:1871083728856832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784404650.046364:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404650.046382:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404650.046385:0:10351:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784404650.046391:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784404650.046541:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10351:1871083728856960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404650.046628:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404650.046669:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.046916:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728856960 00000100:00100000:1.0:1784404650.046923:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728856960 00000100:00100000:1.0:1784404650.046970:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784404650.046990:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:10351:x1871083728856960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.047133:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:10351:x1871083728856960:12345-0@lo:502:llog_process_th.0 Request processed in 153us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.047141:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1784404650.047287:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10351:1871083728856960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784404650.047629:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404650.047638:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404650.047641:0:10351:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784404650.047646:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1784404650.047974:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784404650.048065:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784404650.048076:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.048088:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404650.048099:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784404650.048102:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd565e88000 from 48 10000000:01000000:1.0:1784404650.048127:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784404650.048156:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.048165:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.048175:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404650.048205:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.048249:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.048288:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.048333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857088 00000100:00100000:2.0:1784404650.048339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857088 00000100:00100000:2.0:1784404650.048369:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784404650.048394:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:6517:x1871083728857088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404650.048487:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404650.048502:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541391a00/0x24b3e2e6dcd78dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78db9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.048525:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541391a00/0x24b3e2e6dcd78dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78db9 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.048535:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541391a00/0x24b3e2e6dcd78dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78db9 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.048554:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391a00, rc 0) 00000100:00100000:2.0:1784404650.048595:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728857088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.048602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784404650.048723:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404650.048738:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.048747:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404650.048802:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.048826:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.048847:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.049211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857216 00000100:00100000:2.0:1784404650.049216:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857216 00000100:00100000:2.0:1784404650.049239:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1784404650.049246:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728857216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.049362:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728857216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.049369:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784404650.049542:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.049574:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.049612:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.049639:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.049648:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857344 00000100:00100000:3.0:1784404650.049655:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857344 00000100:00100000:3.0:1784404650.050770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784404650.050786:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728857344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.051144:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728857344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 363us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.051153:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784404650.051249:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.052025:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10352:1871083728857472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.052088:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.056061:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5817a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.056411:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857472 00000100:00100000:3.0:1784404650.056421:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857472 00000100:00100000:3.0:1784404650.056495:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784404650.056506:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:10352:x1871083728857472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.056747:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:10352:x1871083728857472:12345-0@lo:502:llog_process_th.0 Request processed in 241us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.056755:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784404650.059331:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10352:1871083728857472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.059472:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10352:1871083728857600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.059561:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.059602:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.060089:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857600 00000100:00100000:3.0:1784404650.060097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857600 00000100:00100000:3.0:1784404650.060156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784404650.060165:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:10352:x1871083728857600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.060402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:10352:x1871083728857600:12345-0@lo:502:llog_process_th.0 Request processed in 238us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.060417:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784404650.060510:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10352:1871083728857600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784404650.060538:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784404650.060739:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1784404650.060759:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784404650.060768:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.060780:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404650.060790:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784404650.060792:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1784404650.060795:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784404650.061068:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.061077:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.061086:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404650.061111:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.061161:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.061196:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784404650.061446:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857728 00000100:00100000:0.0:1784404650.061452:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857728 00000100:00100000:0.0:1784404650.061493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784404650.061502:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728857728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404650.061514:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404650.061527:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd78dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78dc7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.061552:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd78dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dc7 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.061562:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd78dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dc7 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.061570:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a200, rc 0) 00000100:00100000:0.0:1784404650.061621:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728857728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.061628:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784404650.061658:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404650.061672:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.061693:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404650.061756:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.066725:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.066801:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784404650.068234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857856 00000100:00100000:0.0:1784404650.068248:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857856 00000100:00100000:0.0:1784404650.068350:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784404650.068361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728857856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.068551:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728857856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.068559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784404650.068603:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.068660:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.068720:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.075552:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.076071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728857984 00000100:00100000:2.0:1784404650.076084:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728857984 00000100:00100000:2.0:1784404650.076164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784404650.076174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728857984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.076950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728857984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 773us (8225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.076960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784404650.080726:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728857984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.085689:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10353:1871083728858112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404650.085788:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.085837:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.085969:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728858112 00000100:00100000:1.0:1784404650.085978:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728858112 00000100:00100000:1.0:1784404650.086034:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1784404650.086045:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10353:x1871083728858112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.086195:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10353:x1871083728858112:12345-0@lo:502:llog_process_th.0 Request processed in 152us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.086203:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784404650.086432:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10353:1871083728858112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784404650.086465:0:10353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404650.086475:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404650.086477:0:10353:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784404650.086482:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784404650.086508:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10353:1871083728858240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404650.086547:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.086573:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.086587:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728858240 00000100:00100000:1.0:1784404650.086593:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728858240 00000100:00100000:1.0:1784404650.086668:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1784404650.086678:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10353:x1871083728858240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.086768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10353:x1871083728858240:12345-0@lo:502:llog_process_th.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.086775:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784404650.086933:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10353:1871083728858240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784404650.086951:0:10353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404650.086956:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404650.086958:0:10353:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784404650.086962:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1784404650.087044:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1784404650.087074:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784404650.087086:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.087097:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404650.087107:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784404650.087110:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd544dfc000 from 48 10000000:01000000:3.0:1784404650.087112:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784404650.087163:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.087173:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.087189:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404650.087205:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728858368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.087241:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.087363:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.087462:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728858368 00000100:00100000:2.0:1784404650.087468:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728858368 00000100:00100000:3.0:1784404650.087546:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784404650.087552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728858368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404650.087562:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404650.087575:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821dba00/0x24b3e2e6dcd78ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78dd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.087596:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821dba00/0x24b3e2e6dcd78ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dd5 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.087607:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821dba00/0x24b3e2e6dcd78ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dd5 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404650.087617:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821dba00, rc 0) 00000100:00100000:3.0:1784404650.087659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728858368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.087666:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1784404650.088069:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728858368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404650.088094:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.088105:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404650.088181:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728858496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.088216:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.088252:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404650.088298:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728858496 00000100:00100000:3.0:1784404650.088303:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728858496 00000100:00100000:3.0:1784404650.088338:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784404650.088345:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728858496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.088478:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728858496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.088490:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784404650.088618:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728858496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.088645:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728858624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.088680:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.088702:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.088725:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728858624 00000100:00100000:2.0:1784404650.088731:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728858624 00000100:00100000:2.0:1784404650.088770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1784404650.088778:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728858624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.089256:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728858624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 478us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.089306:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1784404650.089537:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728858624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.089927:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10354:1871083728858752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.089968:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.089988:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728858752 00000100:00100000:3.0:1784404650.089993:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.089993:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728858752 00000100:00100000:1.0:1784404650.090024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784404650.090032:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10354:x1871083728858752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.090144:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10354:x1871083728858752:12345-0@lo:502:llog_process_th.0 Request processed in 112us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.090153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784404650.090163:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10354:1871083728858752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.090201:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10354:1871083728858880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.090232:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.090255:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.090285:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728858880 00000100:00100000:2.0:1784404650.090291:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728858880 00000100:00100000:2.0:1784404650.090395:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784404650.090403:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10354:x1871083728858880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404650.090477:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10354:x1871083728858880:12345-0@lo:502:llog_process_th.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.090484:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784404650.090523:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10354:1871083728858880:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784404650.090543:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784404650.090676:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784404650.090699:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404650.090710:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.090721:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404650.090730:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784404650.090733:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1784404650.090736:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784404650.090761:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.090769:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.090778:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404650.090790:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.090818:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404650.090950:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8e840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.091088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859008 00000100:00100000:2.0:1784404650.091093:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859008 00000100:00100000:2.0:1784404650.091139:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1784404650.091147:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728859008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404650.091155:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404650.091171:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78dea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78de3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.091194:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78de3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.091205:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78de3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.091214:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391400, rc 0) 00000100:00100000:2.0:1784404650.091251:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728859008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.091257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784404650.093057:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404650.093083:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.093096:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404650.093193:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.093254:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.093317:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.093383:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859136 00000100:00100000:2.0:1784404650.093394:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859136 00000100:00100000:2.0:1784404650.093677:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784404650.093688:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728859136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.093891:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728859136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.093898:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784404650.094059:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.094094:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.094149:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.094178:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.094249:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859264 00000100:00100000:1.0:1784404650.094253:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859264 00000100:00100000:1.0:1784404650.094281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784404650.094289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728859264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404650.094371:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728859264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.094379:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784404650.094391:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.094928:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10355:1871083728859392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.094973:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.095037:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.095077:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859392 00000100:00100000:2.0:1784404650.095083:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859392 00000100:00100000:2.0:1784404650.095113:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784404650.095133:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10355:x1871083728859392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404650.095260:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10355:x1871083728859392:12345-0@lo:502:llog_process_th.0 Request processed in 128us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.095267:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784404650.095328:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10355:1871083728859392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404650.095352:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404650.095361:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404650.095364:0:10355:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784404650.095370:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784404650.095389:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10355:1871083728859520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404650.095494:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404650.095558:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404650.095592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859520 00000100:00100000:1.0:1784404650.095597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859520 00000100:00100000:1.0:1784404650.095690:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784404650.095698:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10355:x1871083728859520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404650.095815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10355:x1871083728859520:12345-0@lo:502:llog_process_th.0 Request processed in 118us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.095822:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784404650.095964:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10355:1871083728859520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404650.095984:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404650.095989:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404650.095991:0:10355:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784404650.095994:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1784404650.096158:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1784404650.096178:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784404650.096189:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.096199:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404650.096208:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784404650.096211:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd545b94d40 from 1 10000000:01000000:0.0:1784404650.096214:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784404650.096240:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.096248:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.096256:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404650.096272:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.096303:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.096344:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.096393:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859648 00000100:00100000:2.0:1784404650.096397:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859648 00000100:00100000:2.0:1784404650.096441:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784404650.096450:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728859648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404650.096458:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404650.096470:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78df1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.096490:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78df1 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.096500:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78df1 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404650.096508:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541390400, rc 0) 00000100:00100000:2.0:1784404650.096550:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728859648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.096556:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784404650.096622:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404650.096634:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78df8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.096643:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78df8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404650.096686:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404650.096708:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.096729:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404650.096831:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859776 00000100:00100000:2.0:1784404650.096835:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859776 00000100:00100000:2.0:1784404650.096882:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784404650.096888:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728859776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404650.096952:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728859776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (242us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784404650.096960:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784404650.097064:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728859776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784404650.097083:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784404650.097089:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78df8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404650.097097:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78df8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404650.210380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404650.210434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404650.210476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404650.210592:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831552 00000100:00100000:1.0:1784404650.210603:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831552 00000100:00100000:1.0:1784404650.210682:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:1.0:1784404650.210693:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707831552:12345-192.168.202.42@tcp:400: 00000100:00100000:1.0:1784404650.210763:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707831552:12345-192.168.202.42@tcp:400: Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.212251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404650.212291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404650.212306:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831296 00000100:00100000:2.0:1784404650.212318:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831296 00000100:00100000:0.0:1784404650.212334:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831680 00000100:00100000:0.0:1784404650.212341:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831680 00000100:00100000:2.0:1784404650.212390:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831424 00000100:00100000:0.0:1784404650.212391:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:2.0:1784404650.212396:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831424 00000100:00100000:0.0:1784404650.212406:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707831680:12345-192.168.202.42@tcp:400: 00000100:00100000:2.0:1784404650.212439:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:2.0:1784404650.212451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707831296:12345-192.168.202.42@tcp:400: 00000100:00100000:0.0:1784404650.212492:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707831680:12345-192.168.202.42@tcp:400: Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.212498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707831296:12345-192.168.202.42@tcp:400: Request processed in 47us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.212505:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:2.0:1784404650.212510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:2.0:1784404650.212529:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:2.0:1784404650.212535:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707831424:12345-192.168.202.42@tcp:400: 00000100:00100000:2.0:1784404650.212555:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707831424:12345-192.168.202.42@tcp:400: Request processed in 21us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.212560:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00080000:0.0:1784404650.212587:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404650.212594:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404650.212597:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404650.212600:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404650.213201:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1784404650.215219:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831168 00000100:00100000:3.0:1784404650.215254:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831168 00000100:00100000:3.0:1784404650.215346:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 240 00000100:00100000:3.0:1784404650.215358:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:2404:x1871083707831168:12345-192.168.202.42@tcp:400: 00000100:00100000:3.0:1784404650.215466:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:2404:x1871083707831168:12345-192.168.202.42@tcp:400: Request processed in 111us (4989us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.215474:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 240 00010000:00010000:1.0:1784404650.243192:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404650.371919:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404650.371947:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728859904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404650.372019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404650.372903:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728859904 00000100:00100000:0.0:1784404650.372913:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728859904 00000100:00100000:0.0:1784404650.372969:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784404650.372978:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728859904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404650.373011:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404650.373084:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728859904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404650.373092:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784404650.373190:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728859904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404650.892456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404650.892557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831808 00000100:00100000:1.0:1784404650.892568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831808 00000100:00100000:1.0:1784404650.892631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:1.0:1784404650.892642:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:6173:x1871083707831808:12345-192.168.202.42@tcp:101: 00010000:00010000:1.0:1784404650.892688:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404650.892709:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548000/0x24b3e2e6dcd78dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed70cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.892738:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548000/0x24b3e2e6dcd78dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70cb expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.892749:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548000/0x24b3e2e6dcd78dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70cb expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.892758:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548000, rc 0) 00000100:00100000:1.0:1784404650.892824:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6173:x1871083707831808:12345-192.168.202.42@tcp:101: Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.892831:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:0.0:1784404650.895381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404650.895474:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707831936 00000100:00100000:2.0:1784404650.895503:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707831936 00000100:00100000:2.0:1784404650.895558:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:2.0:1784404650.895568:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6173:x1871083707831936:12345-192.168.202.42@tcp:501: 00000100:00100000:2.0:1784404650.895734:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6173:x1871083707831936:12345-192.168.202.42@tcp:501: Request processed in 166us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.895742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:2.0:1784404650.901664:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404650.901748:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832064 00000100:00100000:3.0:1784404650.901759:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832064 00000100:00100000:3.0:1784404650.901821:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 243 00000100:00100000:3.0:1784404650.901833:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6173:x1871083707832064:12345-192.168.202.42@tcp:503: 00000100:00100000:3.0:1784404650.902022:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6173:x1871083707832064:12345-192.168.202.42@tcp:503: Request processed in 189us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404650.902030:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 243 00000100:00100000:3.0:1784404650.904605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404650.904732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832192 00000100:00100000:1.0:1784404650.904746:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832192 00000100:00100000:1.0:1784404650.904816:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 244 00000100:00100000:1.0:1784404650.904827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6653:x1871083707832192:12345-192.168.202.42@tcp:502: 00000100:00100000:1.0:1784404650.905135:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6653:x1871083707832192:12345-192.168.202.42@tcp:502: Request processed in 307us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.905144:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 244 00000100:00100000:0.0:1784404650.910282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404650.910393:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832320 00000100:00100000:2.0:1784404650.910406:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832320 00000100:00100000:2.0:1784404650.910470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:2.0:1784404650.910482:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6653:x1871083707832320:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784404650.910645:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6653:x1871083707832320:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 165us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404650.910654:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:2.0:1784404650.913511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404650.914074:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832448 00000100:00100000:1.0:1784404650.914085:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832448 00000100:00100000:1.0:1784404650.914210:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:1.0:1784404650.914223:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6173:x1871083707832448:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404650.914239:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404650.914259:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd78e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed70d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.914303:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd78e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d2 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.914314:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd78e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d2 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404650.914336:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549600, rc 0) 00000100:00100000:1.0:1784404650.914415:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707832448:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 194us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404650.914422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:0.0:1784404650.916500:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404650.916573:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832576 00000100:00100000:3.0:1784404650.916584:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832576 00000100:00100000:3.0:1784404650.916639:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 247 00000100:00100000:3.0:1784404650.916649:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707832576:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404650.916764:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707832576:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 117us (272us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784404650.916773:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 247 00010000:00010000:3.0:1784404651.269120:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404651.395115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404651.395140:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728860032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404651.395214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404651.395321:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728860032 00000100:00100000:3.0:1784404651.395330:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728860032 00000100:00100000:3.0:1784404651.395388:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784404651.395398:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728860032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404651.395434:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404651.395488:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728860032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404651.395495:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784404651.395540:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728860032:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1784404651.927121:0:10392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc18443100 20000000:00000080:0.0:1784404651.927141:0:10392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd443692000 uarg=0000000000000000 20000000:01000000:0.0:1784404651.927187:0:10392:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784404651.927194:0:10392:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784404651.927200:0:10392:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784404651.927777:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1784404651.928039:0:10392:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1784404651.931701:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1784404651.931744:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1784404651.931763:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1784404651.931780:0:10392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784404651.932029:0:10392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932052:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd541391600/0x24b3e2e6dcd78a55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932061:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932068:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932075:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932085:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932094:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932152:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932169:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 9 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404651.932186:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860160:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404651.932630:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932644:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404651.932651:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860288:0@lo:104: 00000100:00100000:0.0:1784404651.932688:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404651.932898:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.932905:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404651.932913:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860416:0@lo:104: 00000100:00100000:0.0:1784404651.932939:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404651.933280:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.933288:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 23 pid: 6513 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404651.933297:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860544:0@lo:104: 00010000:00010000:0.0:1784404651.933321:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd541391600/0x24b3e2e6dcd78a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404651.933329:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd541391600/0x24b3e2e6dcd78a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404651.933337:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860672:0@lo:104: 00000100:00100000:0.0:1784404651.933355:0:10392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404651.933362:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784404651.933381:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404651.933395:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404651.933405:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728860288 00000100:00100000:3.0:1784404651.933414:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728860288 00000100:00100000:3.0:1784404651.933460:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728860416 00000100:00100000:2.0:1784404651.933522:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728860544 00000100:00100000:3.0:1784404651.933523:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728860416 00000100:00100000:2.0:1784404651.933525:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728860544 00000100:00100000:3.0:1784404651.933539:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728860672 00000100:00100000:3.0:1784404651.933542:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728860672 00000100:00100000:2.0:1784404651.933543:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784404651.933554:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:10392:x1871083728860288:12345-0@lo:104: 00010000:00010000:2.0:1784404651.933569:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.933626:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784404651.933633:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:10392:x1871083728860288:12345-0@lo:104: Request processed in 80us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404651.933646:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1784404651.933649:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404651.933656:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.933663:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208400 already unused, calling callback (ffffffffc148ec20) 00000100:00100000:2.0:1784404651.933664:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 10000000:00010000:1.0:1784404651.933667:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404651.933669:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443605450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:10392:x1871083728860416:12345-0@lo:104: 00010000:00010000:2.0:1784404651.933677:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.933677:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404651.933685:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404651.933691:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404651.933707:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784404651.933712:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443605450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:10392:x1871083728860416:12345-0@lo:104: Request processed in 44us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404651.933717:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1784404651.933732:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.933748:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784404651.933750:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404651.933755:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:10392:x1871083728860544:12345-0@lo:104: 00010000:00010000:2.0:1784404651.933761:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.933769:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.933775:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208400/0x24b3e2e6dcd78c2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78c31 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.933783:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1784404651.933789:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784404651.933793:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.933799:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404651.933802:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404651.933942:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860288:0@lo:104: 00000100:00100000:0.0:1784404651.933952:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860416:0@lo:104: 00000100:00100000:0.0:1784404651.933958:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860544:0@lo:104: 00000100:00100000:2.0:1784404651.934003:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:10392:x1871083728860544:12345-0@lo:104: Request processed in 247us (620us total) trans 0 rc 0/0 00010000:00010000:3.0:1784404651.934005:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784404651.934010:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404651.934025:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404651.934032:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:10392:x1871083728860672:12345-0@lo:104: 00000100:00100000:3.0:1784404651.934038:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728860800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404651.934040:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.934068:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404651.934070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404651.934072:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:10392:x1871083728860672:12345-0@lo:104: Request processed in 42us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404651.934084:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784404651.934114:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728860800 00000100:00100000:3.0:1784404651.934118:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728860800 00010000:00010000:3.0:1784404651.934138:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404651.934160:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784404651.934165:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728860800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404651.934179:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404651.934184:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.934193:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.934206:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151ac00/0x24b3e2e6dcd78c31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78c2a expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.934218:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404651.934244:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:3646:x1871083728860800:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404651.934250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784404651.934276:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728860800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404651.934350:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404651.934356:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404651.934360:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784404651.934384:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934391:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404651.934400:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934405:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208000/0x24b3e2e6dcd78b04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78b0b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934422:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404651.934425:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934431:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404651.934434:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934439:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404651.934444:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404651.934449:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784404651.934470:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934475:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404651.934490:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934496:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208600/0x24b3e2e6dcd78a4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78a55 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.934505:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404651.934507:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404651.934508:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404651.934519:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728860928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404651.934553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404651.934591:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404651.934600:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728861056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404651.934624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404651.934635:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860672:0@lo:104: 00000100:00100000:1.0:1784404651.934649:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728860928 00000100:00100000:1.0:1784404651.934652:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728860928 00010000:00010000:1.0:1784404651.934668:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404651.935014:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861056 00000100:00100000:2.0:1784404651.935018:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861056 00010000:00010000:2.0:1784404651.935037:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd541391600/0x24b3e2e6dcd78a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404651.935064:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404651.935072:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728860928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404651.935081:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404651.935088:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.935109:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.935124:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d208c00/0x24b3e2e6dcd78b0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78b04 expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.935135:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404651.935168:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:3647:x1871083728860928:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404651.935174:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404651.935187:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784404651.935193:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3649:x1871083728861056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404651.935200:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404651.935204:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd541391600/0x24b3e2e6dcd78a55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 22 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.935224:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd541391600/0x24b3e2e6dcd78a55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 22 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.935310:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541391600/0x24b3e2e6dcd78a55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78a4e expref: 22 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.935321:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404651.935347:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3649:x1871083728861056:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404651.935354:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784404651.935381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728860928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404651.935403:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728861056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404651.935455:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404651.935518:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404651.935522:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404651.935553:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.935562:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404651.935565:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.935572:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404651.935576:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404651.935580:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784404651.935613:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.935620:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404651.935645:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.935653:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78aa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78aa9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404651.935660:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1784404651.935666:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404651.935668:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404651.935669:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404651.935670:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728861184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404651.935699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404651.935729:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861184 00000100:00100000:1.0:1784404651.935734:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861184 00010000:00010000:1.0:1784404651.935750:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 21 pid: 6513 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404651.935766:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404651.935772:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3648:x1871083728861184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404651.935780:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404651.935784:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 21 pid: 6513 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.935793:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 21 pid: 6513 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.935942:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d209600/0x24b3e2e6dcd78aa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78aa2 expref: 21 pid: 6513 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404651.935955:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404651.935990:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:3648:x1871083728861184:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404651.935998:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784404651.936008:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728861184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404651.936895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404651.936960:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832704 00000100:00100000:3.0:1784404651.936967:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832704 00010000:00010000:3.0:1784404651.936992:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 10 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404651.937016:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:2.0:1784404651.937020:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1871083728860160:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404651.937023:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2404:x1871083707832704:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404651.937034:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404651.937038:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 10 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937047:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 10 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.937113:0:10392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937130:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a400/0x24b3e2e6dcd78d49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7093 expref: 10 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937147:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937166:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937180:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937185:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937190:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937193:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937197:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404651.937200:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937204:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937216:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404651.937225:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404651.937243:0:10392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.937250:0:10392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404651.937256:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b200/0x24b3e2e6dcd78e0d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404651.937275:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:2404:x1871083707832704:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 253us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404651.937281:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00010000:00010000:1.0:1784404652.291185:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404652.879224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404652.879326:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832832 00000100:00100000:1.0:1784404652.879336:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832832 00000100:00100000:1.0:1784404652.879392:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 248 00000100:00100000:1.0:1784404652.879404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:6173:x1871083707832832:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404652.879422:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404652.879443:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed70d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404652.879471:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404652.879490:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404652.879500:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548200, rc 0) 00000100:00100000:1.0:1784404652.879551:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707832832:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 149us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404652.879558:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 248 00000100:00100000:0.0:1784404652.884256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404652.884315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707832960 00000100:00100000:1.0:1784404652.884324:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707832960 00000100:00100000:1.0:1784404652.884375:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:1.0:1784404652.884384:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707832960:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404652.884619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707832960:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 235us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404652.884636:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:1.0:1784404652.896753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404652.899994:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833088 00000100:00100000:2.0:1784404652.900019:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833088 00000100:00100000:2.0:1784404652.900086:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:2.0:1784404652.900110:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707833088:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404652.900284:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6173:x1871083707833088:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 177us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404652.900292:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:0.0:1784404652.905364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404652.905589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833216 00000100:00100000:3.0:1784404652.905613:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833216 00000100:00100000:3.0:1784404652.905675:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:3.0:1784404652.905686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6711:x1871083707833216:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784404652.906066:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6711:x1871083707833216:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 381us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404652.906075:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:0.0:1784404652.912394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404652.912464:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833344 00000100:00100000:1.0:1784404652.912475:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833344 00000100:00100000:1.0:1784404652.912544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 252 00000100:00100000:1.0:1784404652.912554:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6711:x1871083707833344:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784404652.912712:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:6711:x1871083707833344:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 159us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404652.912721:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 252 00010000:00010000:1.0:1784404653.321074:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784404653.890990:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784404653.890999:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442280800 from 4 10000000:01000000:0.0:1784404653.891005:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784404653.891064:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404653.891077:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404653.891102:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404653.891138:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784404653.891214:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404653.891279:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404653.891367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861312 00000100:00100000:3.0:1784404653.891376:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861312 00000100:00100000:3.0:1784404653.891436:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1784404653.891446:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728861312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404653.891459:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404653.891472:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78e1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404653.891500:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404653.891510:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404653.891519:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821db600, rc 0) 00000100:00100000:3.0:1784404653.891570:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728861312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404653.891576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1784404653.891731:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404653.891753:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404653.891762:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404653.891881:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404653.891909:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404653.891929:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404653.892097:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861440 00000100:00100000:3.0:1784404653.892103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861440 00000100:00100000:3.0:1784404653.892138:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1784404653.892145:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728861440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404653.892285:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728861440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404653.892293:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1784404653.892396:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404653.892426:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404653.892465:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404653.892494:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.892540:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861568 00000100:00100000:1.0:1784404653.892545:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861568 00000100:00100000:1.0:1784404653.892582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784404653.892589:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728861568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.892676:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728861568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.892683:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784404653.892758:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.893221:0:10491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10491:1871083728861696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.893261:0:10491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.893292:0:10491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3180 going to sleep for 11 seconds 00000100:00100000:0.0:1784404653.893343:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861696 00000100:00100000:0.0:1784404653.893348:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861696 00000100:00100000:0.0:1784404653.893384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784404653.893391:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10491:x1871083728861696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404653.893469:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10491:x1871083728861696:12345-0@lo:502:llog_process_th.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404653.893475:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784404653.893563:0:10491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10491:1871083728861696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784404653.893587:0:10491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404653.893597:0:10491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404653.893600:0:10491:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784404653.893606:0:10491:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd442280800 00000020:00000080:1.0:1784404653.893614:0:10491:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784404653.893694:0:10491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10491:1871083728861824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.893725:0:10491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.893738:0:10491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574f4e780 going to sleep for 11 seconds 00000100:00100000:3.0:1784404653.893888:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861824 00000100:00100000:3.0:1784404653.893893:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861824 00000100:00100000:3.0:1784404653.893915:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1784404653.893922:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10491:x1871083728861824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404653.893993:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:10491:x1871083728861824:12345-0@lo:502:llog_process_th.0 Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404653.894000:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1784404653.894111:0:10491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10491:1871083728861824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784404653.894131:0:10491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404653.894135:0:10491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404653.894137:0:10491:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784404653.894141:0:10491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784404653.894364:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784404653.894387:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404653.894399:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404653.894410:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404653.894420:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784404653.894422:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd574d3a800 from 4 10000000:01000000:3.0:1784404653.894425:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784404653.894451:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404653.894458:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404653.894466:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404653.894491:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404653.894521:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.894553:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443439e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.894604:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728861952 00000100:00100000:1.0:1784404653.894608:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728861952 00000100:00100000:1.0:1784404653.894636:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784404653.894642:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728861952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404653.894651:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404653.894662:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78e29 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.894693:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.894702:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.894711:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549e00, rc 0) 00000100:00100000:1.0:1784404653.894740:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728861952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.894745:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1784404653.895018:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728861952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404653.895033:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404653.895042:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404653.895102:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404653.895128:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.897298:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443439e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.900065:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862080 00000100:00100000:1.0:1784404653.900089:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862080 00000100:00100000:1.0:1784404653.900156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784404653.900164:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728862080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.900311:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728862080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (5181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.900318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784404653.900378:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.900430:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.900477:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.900507:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.900520:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862208 00000100:00100000:1.0:1784404653.900524:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862208 00000100:00100000:1.0:1784404653.900545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784404653.900551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728862208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.900622:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728862208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.900629:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784404653.900662:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404653.908367:0:10493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10493:1871083728862336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404653.908472:0:10493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.908562:0:10493:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443439840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.911268:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862336 00000100:00100000:1.0:1784404653.911288:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862336 00000100:00100000:1.0:1784404653.913022:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784404653.913043:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10493:x1871083728862336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.913268:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10493:x1871083728862336:12345-0@lo:502:llog_process_th.0 Request processed in 233us (4795us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.913277:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784404653.913407:0:10493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10493:1871083728862336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404653.913444:0:10493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404653.913455:0:10493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404653.913457:0:10493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784404653.913470:0:10493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd574d3a800 00000020:00000080:3.0:1784404653.913473:0:10493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784404653.914050:0:10493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10493:1871083728862464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404653.914113:0:10493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.922039:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862464 00000100:00100000:2.0:1784404653.922055:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862464 00000100:00100000:2.0:1784404653.922130:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784404653.922144:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10493:x1871083728862464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404653.922319:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:10493:x1871083728862464:12345-0@lo:502:llog_process_th.0 Request processed in 178us (8205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.922327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784404653.923724:0:10493:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443439840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404653.923760:0:10493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10493:1871083728862464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784404653.923809:0:10493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404653.923820:0:10493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404653.923833:0:10493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784404653.923840:0:10493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784404653.928019:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784404653.928071:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784404653.928096:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.928112:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404653.928125:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784404653.928128:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd565e88000 from 4 10000000:01000000:1.0:1784404653.928131:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404653.928177:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.928185:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.928198:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404653.928228:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.928301:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.928354:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.930337:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862592 00000100:00100000:1.0:1784404653.930353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862592 00000100:00100000:1.0:1784404653.930418:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784404653.930427:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728862592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404653.930444:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404653.930463:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78e37 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.930506:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.930519:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.930530:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549400, rc 0) 00000100:00100000:1.0:1784404653.930621:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728862592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.930629:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784404653.930689:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404653.930709:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.930719:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404653.930809:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.930884:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.930918:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.930933:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862720 00000100:00100000:1.0:1784404653.930937:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862720 00000100:00100000:1.0:1784404653.930958:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784404653.930964:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728862720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.931100:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728862720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.931118:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784404653.931148:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.931177:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.931233:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.931247:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.931339:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862848 00000100:00100000:1.0:1784404653.931344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862848 00000100:00100000:1.0:1784404653.931361:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784404653.931367:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728862848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.931440:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728862848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.931447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784404653.931484:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728862848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.931709:0:10496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10496:1871083728862976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.931742:0:10496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.931761:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728862976 00000100:00100000:1.0:1784404653.931764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728862976 00000100:00100000:1.0:1784404653.931786:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784404653.931792:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10496:x1871083728862976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.931878:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10496:x1871083728862976:12345-0@lo:502:llog_process_th.0 Request processed in 86us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.931884:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784404653.931916:0:10496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.931927:0:10496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10496:1871083728862976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784404653.931950:0:10496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404653.931959:0:10496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404653.931962:0:10496:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784404653.931969:0:10496:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd565e88000 00000020:00000080:1.0:1784404653.931972:0:10496:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784404653.932051:0:10496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10496:1871083728863104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.932108:0:10496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.932128:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728863104 00000100:00100000:1.0:1784404653.932131:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728863104 00000100:00100000:1.0:1784404653.932153:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784404653.932160:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10496:x1871083728863104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.932220:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:10496:x1871083728863104:12345-0@lo:502:llog_process_th.0 Request processed in 60us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.932227:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784404653.932256:0:10496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.932268:0:10496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10496:1871083728863104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784404653.932285:0:10496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404653.932289:0:10496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404653.932291:0:10496:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784404653.932294:0:10496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784404653.932341:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784404653.932359:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784404653.932367:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.932376:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404653.932396:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784404653.932399:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd544dfc000 from 4 10000000:01000000:1.0:1784404653.932402:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404653.932423:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.932431:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.932440:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404653.932453:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728863232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.932478:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.932491:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.932504:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728863232 00000100:00100000:1.0:1784404653.932507:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728863232 00000100:00100000:1.0:1784404653.932528:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784404653.932533:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728863232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404653.932541:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404653.932552:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78e45 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.932570:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.932579:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.932597:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548c00, rc 0) 00000100:00100000:1.0:1784404653.932626:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728863232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.932632:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784404653.932663:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728863232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404653.932674:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.932683:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404653.932722:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728863360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.932746:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.932759:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.932770:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728863360 00000100:00100000:1.0:1784404653.932773:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728863360 00000100:00100000:1.0:1784404653.932793:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784404653.932800:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728863360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.932895:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728863360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.932901:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784404653.932931:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728863360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.932957:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728863488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.932991:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404653.933011:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.933022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728863488 00000100:00100000:1.0:1784404653.933026:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728863488 00000100:00100000:1.0:1784404653.933046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1784404653.933053:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728863488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404653.937249:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728863488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4185us (4247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.937266:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1784404653.937383:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728863488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404653.941250:0:10497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10497:1871083728863616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404653.941783:0:10497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.941847:0:10497:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.942247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728863616 00000100:00100000:1.0:1784404653.942258:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728863616 00000100:00100000:1.0:1784404653.942309:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784404653.942331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:10497:x1871083728863616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.942760:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:10497:x1871083728863616:12345-0@lo:502:llog_process_th.0 Request processed in 430us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.942769:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784404653.942910:0:10497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10497:1871083728863616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784404653.942943:0:10497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404653.942952:0:10497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404653.942954:0:10497:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784404653.942968:0:10497:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd544dfc000 00000020:00000080:2.0:1784404653.942971:0:10497:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784404653.943065:0:10497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10497:1871083728863744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404653.943119:0:10497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.943145:0:10497:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404653.943764:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728863744 00000100:00100000:1.0:1784404653.943772:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728863744 00000100:00100000:1.0:1784404653.943867:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784404653.943877:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:10497:x1871083728863744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404653.943982:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:10497:x1871083728863744:12345-0@lo:502:llog_process_th.0 Request processed in 106us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404653.943990:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784404653.944209:0:10497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:10497:1871083728863744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784404653.944233:0:10497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404653.944240:0:10497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404653.944242:0:10497:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784404653.944247:0:10497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784404653.944732:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784404653.944755:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784404653.944765:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404653.944785:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404653.958487:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728863872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404653.958579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.958634:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404653.958641:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728864000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404653.958663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.958698:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728863872 00000100:00100000:3.0:1784404653.958706:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728863872 00000100:00100000:3.0:1784404653.958759:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864000 00000100:00100000:3.0:1784404653.958764:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864000 00000100:00100000:3.0:1784404653.958937:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784404653.958948:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728863872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404653.959058:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404653.959119:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728863872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 173us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404653.959126:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784404653.959147:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784404653.959154:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728864000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404653.959170:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404653.959199:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728864000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404653.959205:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1784404653.959222:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784404653.959226:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784404653.959356:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728864384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404653.959381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.959399:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728864896:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.959423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.959451:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728865408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.959473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784404653.959508:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362e680 x1871083728864000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404653.959527:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728864000:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1784404653.959538:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362ce00 x1871083728863872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404653.959548:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728863872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404653.959572:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784404653.959578:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728864512:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.959602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.959621:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728865024:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.959640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.959665:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728864128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.959687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.959703:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728864640:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.959723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404653.959739:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728865152:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.959757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.960144:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728865536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404653.960174:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.960206:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864384 00000100:00100000:2.0:1784404653.960211:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864384 00000100:00100000:2.0:1784404653.960248:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865536 00000100:00100000:2.0:1784404653.960251:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865536 00000100:00100000:2.0:1784404653.960266:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784404653.960272:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728864384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404653.960287:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404653.960319:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728864384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.960326:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784404653.960341:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784404653.960347:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728865536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404653.960357:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404653.960386:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728865536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.960404:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784404653.960423:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728864256:0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.960451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.960468:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728864768:0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.960501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.960512:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728865280:0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.960531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404653.960556:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864896 00000100:00100000:2.0:1784404653.960560:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864896 00000100:00100000:2.0:1784404653.960582:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864512 00000100:00100000:2.0:1784404653.960585:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864512 00000100:00100000:2.0:1784404653.960596:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864128 00000100:00100000:2.0:1784404653.960598:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864128 00000100:00100000:2.0:1784404653.960609:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865152 00000100:00100000:2.0:1784404653.960611:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865152 00000100:00100000:2.0:1784404653.960623:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864768 00000100:00100000:2.0:1784404653.960625:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864768 00000100:00100000:2.0:1784404653.960636:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865280 00000100:00100000:2.0:1784404653.960637:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865280 00000100:00100000:2.0:1784404653.960649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404653.960655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.960691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728864896:12345-0@lo:400:kworker.0 Request processed in 37us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.960697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404653.960709:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784404653.960714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728864512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.960739:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728864512:12345-0@lo:400:kworker.0 Request processed in 25us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.960752:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784404653.960764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404653.960778:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728864128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.960806:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728864128:12345-0@lo:400:kworker.0 Request processed in 29us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.960811:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404653.960821:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404653.960827:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728865152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.961119:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728865152:12345-0@lo:400:kworker.0 Request processed in 291us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.961126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404653.961137:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404653.961144:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728864768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.961176:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728864768:12345-0@lo:400:kworker.0 Request processed in 33us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.961181:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404653.961191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784404653.961196:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728865280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.961218:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728865280:12345-0@lo:400:kworker.0 Request processed in 22us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.961223:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784404653.961338:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728864512:0@lo:400:kworker.0 00010000:00080000:2.0:1784404653.961354:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443633b80 x1871083728864384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404653.961383:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728864384:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784404653.961398:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362f480 x1871083728864896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404653.961407:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728864896:0@lo:400:kworker.0 00000100:00080000:2.0:1784404653.961438:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404653.961443:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404653.961446:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404653.961448:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784404653.961466:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e28e00 x1871083728865536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404653.961477:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728865536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404653.961502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864640 00000100:00100000:2.0:1784404653.961507:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864640 00000100:00100000:2.0:1784404653.961528:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728864256 00000100:00100000:2.0:1784404653.961531:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728864256 00000100:00100000:2.0:1784404653.961542:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404653.961547:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.961582:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728864640:12345-0@lo:400:kworker.0 Request processed in 34us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.961588:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404653.961599:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784404653.961605:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728864256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.961631:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728864256:12345-0@lo:400:kworker.0 Request processed in 26us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404653.961637:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784404653.961670:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728864256:0@lo:400:kworker.0 00000100:00100000:2.0:1784404653.961681:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728864768:0@lo:400:kworker.0 00010000:00080000:2.0:1784404653.961690:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362c700 x1871083728865280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404653.961698:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728865280:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.962266:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728865152:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.962287:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728864128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.962296:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728864640:0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.962329:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865408 00000100:00100000:3.0:1784404653.962341:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865408 00000100:00100000:3.0:1784404653.962379:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865024 00000100:00100000:3.0:1784404653.962383:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865024 00000100:00100000:3.0:1784404653.962403:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784404653.962409:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728865408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.962611:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728865408:12345-0@lo:400:kworker.0 Request processed in 202us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404653.962619:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784404653.962634:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784404653.962639:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728865024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404653.962667:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728865024:12345-0@lo:400:kworker.0 Request processed in 28us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404653.962672:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1784404653.962925:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362f800 x1871083728865024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404653.962939:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728865024:0@lo:400:kworker.0 00010000:00080000:2.0:1784404653.962953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435d9180 x1871083728865408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404653.962961:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728865408:0@lo:400:kworker.0 00010000:00010000:3.0:1784404654.340429:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404655.317245:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404655.317301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404655.317329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404655.317476:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833728 00000100:00100000:3.0:1784404655.317486:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833728 00000100:00100000:3.0:1784404655.317558:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:3.0:1784404655.317569:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707833728:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404655.317646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707833728:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404655.317654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:3.0:1784404655.317678:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833984 00000100:00100000:3.0:1784404655.317694:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833984 00000100:00100000:3.0:1784404655.317724:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1784404655.317731:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707833984:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:2.0:1784404655.317744:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404655.317748:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404655.317759:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707833984:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404655.317792:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1784404655.317802:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833472 00000100:00100000:1.0:1784404655.317807:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833472 00000100:00100000:1.0:1784404655.317901:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 273 00000100:00100000:1.0:1784404655.317910:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2401:x1871083707833472:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404655.317938:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2401:x1871083707833472:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404655.317944:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 273 00000100:00100000:0.0:1784404655.319612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404655.319664:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404655.319738:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833600 00000100:00100000:0.0:1784404655.319745:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833600 00000100:00100000:0.0:1784404655.319806:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:0.0:1784404655.319816:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707833600:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404655.319909:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707833600:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404655.319916:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:0.0:1784404655.319941:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707833856 00000100:00100000:0.0:1784404655.319945:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707833856 00000100:00100000:0.0:1784404655.319973:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:0.0:1784404655.319980:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707833856:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404655.320006:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707833856:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404655.320013:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00080000:2.0:1784404655.322048:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404655.322057:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784404655.363326:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404655.492719:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728865664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404655.492815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404655.492886:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865664 00000100:00100000:2.0:1784404655.492896:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865664 00000100:00100000:2.0:1784404655.492957:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404655.492968:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728865664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404655.493009:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404655.493084:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728865664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404655.493091:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784404655.493129:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728865664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784404656.387336:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404656.518104:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728865792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404656.518190:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404656.518339:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865792 00000100:00100000:3.0:1784404656.518348:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865792 00000100:00100000:3.0:1784404656.518402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784404656.518412:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728865792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404656.518597:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404656.518688:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728865792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 277us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404656.518695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404656.518755:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728865792:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784404657.413030:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784404658.184788:0:10693:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1784404658.435129:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404659.076058:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728865920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404659.076309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.076398:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404659.076406:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728866048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404659.076430:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.076470:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728865920 00000100:00100000:2.0:1784404659.076479:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728865920 00000100:00100000:2.0:1784404659.076548:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866048 00000100:00100000:2.0:1784404659.076552:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866048 00000100:00100000:2.0:1784404659.076571:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784404659.076584:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728865920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404659.076617:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404659.076662:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728865920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.076669:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784404659.076688:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784404659.076695:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728866048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404659.076710:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404659.076736:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728866048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.076742:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1784404659.076758:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404659.076763:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784404659.076815:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c928000 x1871083728866048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404659.076834:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728866048:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784404659.076844:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e2a300 x1871083728865920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404659.076879:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728865920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404659.079424:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728866176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404659.079492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.079568:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866176 00000100:00100000:2.0:1784404659.079576:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866176 00000100:00100000:2.0:1784404659.079624:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784404659.079632:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728866176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404659.079654:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404659.079695:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728866176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.079702:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1784404659.079739:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784404659.079768:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e2a300 x1871083728866176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404659.079787:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728866176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404659.080520:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728866304:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.080563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.080602:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728866816:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.080627:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.080665:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728867328:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.080735:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.080757:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784404659.080764:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728866688:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.080802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.080822:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728867200:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.080843:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.080898:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866816 00000100:00100000:2.0:1784404659.080904:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866816 00000100:00100000:2.0:1784404659.081344:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404659.081354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728866816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081409:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728866816:12345-0@lo:400:kworker.0 Request processed in 58us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.081417:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404659.081443:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867328 00000100:00100000:2.0:1784404659.081446:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867328 00000100:00100000:2.0:1784404659.081478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866688 00000100:00100000:2.0:1784404659.081481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866688 00000100:00100000:2.0:1784404659.081493:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867200 00000100:00100000:2.0:1784404659.081496:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867200 00000100:00100000:2.0:1784404659.081519:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784404659.081527:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728867328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081558:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728867328:12345-0@lo:400:kworker.0 Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.081564:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784404659.081576:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784404659.081581:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728866688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081620:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728866688:12345-0@lo:400:kworker.0 Request processed in 39us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.081626:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784404659.081637:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784404659.081644:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728867200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081669:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728867200:12345-0@lo:400:kworker.0 Request processed in 26us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.081675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784404659.081707:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728866560:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.081753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728867072:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081773:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.081793:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784404659.081799:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728866432:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.081832:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728866944:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.081873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.081892:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728867456:0@lo:400:kworker.0 00000100:00100000:0.0:1784404659.082386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866304 00000100:00100000:0.0:1784404659.082392:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866304 00000100:00100000:0.0:1784404659.082427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1784404659.082434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728866304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.082624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404659.082667:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867456 00000100:00100000:1.0:1784404659.082672:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867456 00000100:00100000:1.0:1784404659.082705:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784404659.082711:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728867456:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784404659.083114:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404659.083122:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404659.083124:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404659.083271:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728866304:12345-0@lo:400:kworker.0 Request processed in 836us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404659.083279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784404659.083626:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728867584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404659.083659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404659.083694:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867584 00000100:00100000:2.0:1784404659.083699:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867584 00000100:00100000:2.0:1784404659.083744:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404659.083752:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728867584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404659.083784:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404659.083825:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728867584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.083831:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404659.083866:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867072 00000100:00100000:2.0:1784404659.083870:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867072 00000100:00100000:2.0:1784404659.083897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866432 00000100:00100000:2.0:1784404659.083900:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866432 00000100:00100000:2.0:1784404659.083910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866944 00000100:00100000:2.0:1784404659.083912:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866944 00000100:00100000:2.0:1784404659.083942:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784404659.083948:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728867072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.083977:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728867072:12345-0@lo:400:kworker.0 Request processed in 30us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.083983:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784404659.083992:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784404659.083997:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728866432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.084018:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728866432:12345-0@lo:400:kworker.0 Request processed in 21us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.084023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784404659.084031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784404659.084066:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728866944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.084089:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728866944:12345-0@lo:400:kworker.0 Request processed in 54us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.084094:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1784404659.084329:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404659.084333:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404659.084350:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728866560 00000100:00100000:2.0:1784404659.084354:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728866560 00000100:00100000:2.0:1784404659.084377:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784404659.084383:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728866560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.084414:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728866560:12345-0@lo:400:kworker.0 Request processed in 31us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404659.084419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1784404659.084460:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92aa00 x1871083728867584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404659.084477:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728867584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404659.084488:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728866432:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.084497:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728866944:0@lo:400:kworker.0 00000100:00100000:2.0:1784404659.084505:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728866560:0@lo:400:kworker.0 00010000:00080000:2.0:1784404659.084524:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442554000 x1871083728867072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404659.084532:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728867072:0@lo:400:kworker.0 00000100:00100000:1.0:1784404659.085421:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728867456:12345-0@lo:400:kworker.0 Request processed in 2708us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404659.085432:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1784404659.085835:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442555c00 x1871083728867456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404659.085868:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728867456:0@lo:400:kworker.0 00000100:00100000:3.0:1784404659.090153:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728866688:0@lo:400:kworker.0 00000100:00100000:3.0:1784404659.090175:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728867200:0@lo:400:kworker.0 00000100:00100000:3.0:1784404659.090186:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728866304:0@lo:400:kworker.0 00000100:00100000:3.0:1784404659.090198:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728866816:0@lo:400:kworker.0 00010000:00080000:3.0:1784404659.090215:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442555f80 x1871083728867328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404659.090227:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728867328:0@lo:400:kworker.0 00010000:00010000:1.0:1784404659.459260:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404660.429888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404660.429954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404660.429985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404660.430009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404660.430044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404660.430074:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707834624 00000100:00100000:1.0:1784404660.430084:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707834624 00000100:00100000:1.0:1784404660.430141:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707834496 00000100:00100000:1.0:1784404660.430144:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707834496 00000100:00100000:1.0:1784404660.430168:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784404660.430178:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707834624:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404660.430254:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707834624:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404660.430262:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784404660.430286:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1784404660.430294:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707834496:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404660.430322:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707834496:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404660.430328:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784404660.430513:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707834112 00000100:00100000:2.0:1784404660.430518:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707834112 00000100:00100000:2.0:1784404660.430559:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 275 00000100:00100000:2.0:1784404660.430566:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707834112:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404660.430610:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707834112:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 44us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404660.430617:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 275 00000100:00100000:2.0:1784404660.430649:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707834368 00000100:00100000:2.0:1784404660.430653:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707834368 00000100:00100000:2.0:1784404660.430679:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707834240 00000100:00100000:2.0:1784404660.430682:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707834240 00000100:00100000:2.0:1784404660.430700:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:2.0:1784404660.430706:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707834368:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404660.430731:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707834368:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404660.430737:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:2.0:1784404660.430748:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:2.0:1784404660.430754:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707834240:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404660.430774:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707834240:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 20us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404660.430779:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00080000:2.0:1784404660.430793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404660.430797:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404660.430799:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404660.430801:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784404660.482961:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404660.619508:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728867712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404660.619595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404660.619746:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867712 00000100:00100000:0.0:1784404660.619755:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867712 00000100:00100000:0.0:1784404660.619808:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784404660.619819:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728867712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404660.619878:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404660.619942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728867712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404660.619950:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784404660.620058:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728867712:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784404661.507082:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404661.635222:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404661.635245:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728867840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404661.635323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404661.635438:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867840 00000100:00100000:3.0:1784404661.635446:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867840 00000100:00100000:3.0:1784404661.635503:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784404661.635514:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728867840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404661.635550:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404661.635596:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728867840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404661.635605:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784404661.635692:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728867840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784404662.530970:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784404663.087362:0:10937:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing yml_node 00010000:00010000:0.0:1784404663.556965:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404664.195215:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728868096:0@lo:400:kworker.0 00000100:00100000:0.0:1784404664.195325:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728868352:0@lo:400:kworker.0 00000100:00100000:1.0:1784404664.195430:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728868224:0@lo:400:kworker.0 00000100:00100000:2.0:1784404664.195846:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728867968:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.198329:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728868608:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.198409:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728869120:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.198477:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868096 00000100:00100000:3.0:1784404664.198486:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868096 00000100:00100000:3.0:1784404664.198534:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868608 00000100:00100000:3.0:1784404664.198538:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868608 00000100:00100000:3.0:1784404664.198563:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728869120 00000100:00100000:3.0:1784404664.198567:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728869120 00000100:00100000:3.0:1784404664.198585:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784404664.198594:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728868096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198652:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728868096:12345-0@lo:400:kworker.0 Request processed in 58us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.198659:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784404664.198675:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784404664.198695:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728868608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198725:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728868608:12345-0@lo:400:kworker.0 Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.198744:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784404664.198756:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784404664.198762:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728869120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198791:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728869120:12345-0@lo:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.198797:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1784404664.198833:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404664.198884:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728868608:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198895:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728869120:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198905:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728868096:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.198976:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728869632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404664.199059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404664.199108:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404664.199142:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728868864:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.199144:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728869632 00000100:00100000:3.0:1784404664.199149:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728869632 00000100:00100000:0.0:1784404664.199175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.199188:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784404664.199197:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728869632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404664.199213:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728869376:0@lo:400:kworker.0 00002000:00000024:3.0:1784404664.199219:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404664.199240:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.199271:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728869632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.199278:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784404664.199282:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728869888:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784404664.199294:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404664.199312:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435d9f80 x1871083728869632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404664.199336:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728869632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404664.199372:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868864 00000100:00100000:3.0:1784404664.199375:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868864 00000100:00100000:3.0:1784404664.199402:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728869376 00000100:00100000:3.0:1784404664.199406:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728869376 00000100:00100000:3.0:1784404664.199424:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784404664.199431:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728868864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.199461:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728868864:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.199467:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784404664.199478:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784404664.199484:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728869376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.199510:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728869376:12345-0@lo:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.199516:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1784404664.199530:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404664.199533:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404664.199539:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868352 00000100:00100000:3.0:1784404664.199542:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868352 00000100:00100000:3.0:1784404664.199561:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784404664.199566:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728868352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.199596:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728868352:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.199602:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784404664.199649:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404664.199656:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728870016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404664.199698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.199730:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870016 00000100:00100000:3.0:1784404664.199734:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870016 00000100:00100000:3.0:1784404664.199759:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784404664.199767:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728870016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404664.199782:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404664.199828:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728870016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404664.199834:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.199839:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784404664.199877:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728869888 00000100:00100000:3.0:1784404664.199881:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728869888 00000100:00100000:0.0:1784404664.199899:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728868352:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.199913:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1784404664.199918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9b480 x1871083728868864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404664.199925:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728869888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404664.199935:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728868864:0@lo:400:kworker.0 00002000:00000024:3.0:1784404664.199939:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1784404664.199950:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca18700 x1871083728869376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404664.199958:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728869376:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.199975:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728869888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.199981:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1784404664.199985:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435db800 x1871083728869888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784404664.200008:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404664.200025:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728869888:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784404664.200032:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435d9f80 x1871083728870016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404664.200038:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404664.200048:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728869760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404664.200051:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728870016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404664.200076:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404664.200110:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728869760 00000100:00100000:0.0:1784404664.200114:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728869760 00000100:00100000:0.0:1784404664.200138:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784404664.200146:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728869760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784404664.200159:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404664.200195:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728869760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404664.200214:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1784404664.200232:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435d8000 x1871083728869760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404664.200247:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728869760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404664.200882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404664.200913:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728868736:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.200933:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868224 00000100:00100000:1.0:1784404664.200944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.200945:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868224 00000100:00100000:3.0:1784404664.200982:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784404664.201023:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728869248:0@lo:400:kworker.0 00000100:00100000:1.0:1784404664.201045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.201073:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728868224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.201123:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728868224:12345-0@lo:400:kworker.0 Request processed in 133us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.201130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784404664.201136:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728868224:0@lo:400:kworker.0 00000100:00100000:0.0:1784404664.201178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868736 00000100:00100000:0.0:1784404664.201182:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868736 00000100:00080000:3.0:1784404664.201258:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404664.201900:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728869248 00000100:00100000:0.0:1784404664.201906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728869248 00000100:00100000:3.0:1784404664.201937:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784404664.201945:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784404664.201950:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728868736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404664.201957:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728869248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.202034:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728868736:12345-0@lo:400:kworker.0 Request processed in 87us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.202041:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1784404664.202078:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404664.202098:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728869248:12345-0@lo:400:kworker.0 Request processed in 144us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404664.202106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784404664.202144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784404664.202158:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9ad80 x1871083728868736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404664.202170:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728868736:0@lo:400:kworker.0 00000100:00100000:2.0:1784404664.202181:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728868480:0@lo:400:kworker.0 00010000:00080000:1.0:1784404664.202181:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca1a300 x1871083728869248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404664.202188:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728869248:0@lo:400:kworker.0 00000100:00100000:2.0:1784404664.202207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404664.202228:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728868992:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.202249:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868480 00000100:00100000:2.0:1784404664.202255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.202256:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868480 00000100:00100000:2.0:1784404664.202285:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728868992 00000100:00100000:2.0:1784404664.202290:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728868992 00000100:00100000:3.0:1784404664.202294:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784404664.202303:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404664.202326:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784404664.202335:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728868992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.202343:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728868480:12345-0@lo:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404664.202350:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784404664.202378:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728868992:12345-0@lo:400:kworker.0 Request processed in 43us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404664.202385:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1784404664.202396:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca1a680 x1871083728868992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404664.202408:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728868992:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.202416:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728869504:0@lo:400:kworker.0 00000100:00100000:3.0:1784404664.202441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404664.202480:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728868480:0@lo:400:kworker.0 00000100:00100000:0.0:1784404664.202784:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728867968 00000100:00100000:0.0:1784404664.202789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728867968 00000100:00100000:0.0:1784404664.202823:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784404664.202830:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728867968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404664.202909:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728867968:12345-0@lo:400:kworker.0 Request processed in 79us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404664.202922:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784404664.203000:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728867968:0@lo:400:kworker.0 00000100:00100000:2.0:1784404664.203342:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728869504 00000100:00100000:2.0:1784404664.203348:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728869504 00000100:00100000:2.0:1784404664.203387:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784404664.203395:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728869504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404664.203437:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728869504:12345-0@lo:400:kworker.0 Request processed in 42us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404664.203444:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1784404664.203464:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca19880 x1871083728869504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404664.203477:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728869504:0@lo:400:kworker.0 00010000:00010000:0.0:1784404664.579463:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404665.556256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404665.556565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404665.556663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404665.556842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404665.556924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404665.557011:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835136 00000100:00100000:2.0:1784404665.557022:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835136 00000100:00100000:2.0:1784404665.557091:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835264 00000100:00100000:2.0:1784404665.557095:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835264 00000100:00100000:2.0:1784404665.557119:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:2.0:1784404665.557129:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2400:x1871083707835136:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:2.0:1784404665.557171:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d5e 00000100:00080000:2.0:1784404665.557197:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd44333e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404665.557246:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1784404665.557603:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+2:2400:x1871083707835136:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 474us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404665.557612:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:2.0:1784404665.557691:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1784404665.557700:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2400:x1871083707835264:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:2.0:1784404665.557714:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d65 00000100:00080000:2.0:1784404665.557720:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd443586000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404665.557744:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1784404665.557821:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+2:2400:x1871083707835264:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 123us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404665.557828:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00080000:1.0:1784404665.559894:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404665.559903:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784404665.559930:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404665.559940:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404665.562027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707834752 00000100:00100000:0.0:1784404665.562257:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707834752 00000100:00100000:0.0:1784404665.562363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 277 00000100:00100000:0.0:1784404665.562374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707834752:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404665.562465:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707834752:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 92us (5900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404665.562474:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 277 00000100:00100000:3.0:1784404665.564628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707834880 00000100:00100000:3.0:1784404665.564643:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707834880 00000100:00100000:3.0:1784404665.564793:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835008 00000100:00100000:3.0:1784404665.564798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835008 00000100:00100000:3.0:1784404665.564834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00080000:1.0:1784404665.564877:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404665.564882:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404665.564948:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:3.0:1784404665.564952:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707834880:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404665.564965:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707835008:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404665.565179:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707835008:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 219us (8515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404665.565188:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:3.0:1784404665.565257:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707834880:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 309us (9008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404665.565266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 82 00010000:00010000:0.0:1784404665.609338:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404665.731438:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404665.731463:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728870144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404665.731535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404665.731794:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870144 00000100:00100000:0.0:1784404665.731801:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870144 00000100:00100000:0.0:1784404665.731872:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784404665.732480:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728870144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404665.732516:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404665.732578:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728870144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 228us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404665.732585:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784404665.733001:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728870144:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1784404666.397190:0:11120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.174 00010000:00010000:1.0:1784404666.628111:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404666.757896:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404666.757920:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728870272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404666.758019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404666.758097:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870272 00000100:00100000:1.0:1784404666.758105:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870272 00000100:00100000:1.0:1784404666.758153:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784404666.758161:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728870272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404666.758199:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784404666.758270:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728870272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404666.758279:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784404666.758329:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728870272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784404667.651966:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784404668.451623:0:11218:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.174 00010000:00010000:0.0:1784404668.675287:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404669.315372:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728870528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404669.315372:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728870400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404669.317624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404669.319236:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870400 00000100:00100000:2.0:1784404669.319251:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870400 00000100:00100000:2.0:1784404669.319328:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784404669.319344:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728870400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404669.319389:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404669.319501:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728870400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404669.319510:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1784404669.319538:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784404669.319748:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44352a300 x1871083728870400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404669.319770:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728870400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404669.319906:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728870656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404669.319956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404669.320360:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870656 00000100:00100000:1.0:1784404669.320365:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870656 00000100:00080000:2.0:1784404669.320389:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404669.320400:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784404669.320407:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728870656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404669.320428:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404669.320428:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728870784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404669.320456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404669.320465:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728870656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404669.320608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404669.320629:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728871040:0@lo:400:kworker.0 00000100:00100000:3.0:1784404669.320656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404669.320673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728871552:0@lo:400:kworker.0 00000100:00100000:3.0:1784404669.320692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404669.320713:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871040 00000100:00100000:3.0:1784404669.320716:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871040 00000100:00100000:3.0:1784404669.320743:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871552 00000100:00100000:3.0:1784404669.320746:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871552 00000100:00100000:3.0:1784404669.320768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784404669.320774:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728871040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404669.320817:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728871040:12345-0@lo:400:kworker.0 Request processed in 43us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404669.320824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784404669.320962:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784404669.320969:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728871552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404669.322907:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728871552:12345-0@lo:400:kworker.0 Request processed in 1936us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404669.322919:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784404669.323958:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870784 00000100:00100000:2.0:1784404669.323969:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870784 00000100:00100000:2.0:1784404669.324022:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870528 00000100:00100000:2.0:1784404669.324026:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870528 00000100:00100000:2.0:1784404669.324045:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784404669.324054:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728870784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404669.324079:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404669.324142:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728870784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404669.324149:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784404669.324167:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784404669.324173:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728870528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404669.324186:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404669.324216:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728870528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404669.324223:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1784404669.324256:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404669.324262:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404669.324265:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404669.324286:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728871168:0@lo:400:kworker.0 00000100:00100000:2.0:1784404669.324344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404669.324386:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728871680:0@lo:400:kworker.0 00000100:00100000:2.0:1784404669.324413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784404669.324450:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e4a80 x1871083728870656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404669.324612:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871680 00000100:00100000:0.0:1784404669.324618:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871680 00000100:00100000:0.0:1784404669.324664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784404669.324673:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728871680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.324714:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728871680:12345-0@lo:400:kworker.0 Request processed in 43us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404669.324720:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784404669.324745:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728871296:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.324773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404669.324789:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728871808:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.324811:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784404669.324960:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e7800 x1871083728870784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404669.326583:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1784404669.328972:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404669.330964:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871296 00000100:00100000:1.0:1784404669.330979:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871296 00000100:00100000:1.0:1784404669.331036:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784404669.331046:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728871296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404669.331138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728871296:12345-0@lo:400:kworker.0 Request processed in 93us (6363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404669.331162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784404669.331220:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728870784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404669.331274:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728871296:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331286:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784404669.331300:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728870912:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404669.331403:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728871424:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404669.331448:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728870912 00000100:00100000:0.0:1784404669.331451:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728871936:0@lo:400:kworker.0 00000100:00100000:1.0:1784404669.331452:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728870912 00000100:00100000:0.0:1784404669.331472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404669.331478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784404669.331485:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728870912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331497:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871808 00000100:00100000:0.0:1784404669.331501:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871808 00000100:00100000:1.0:1784404669.331516:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728870912:12345-0@lo:400:kworker.0 Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404669.331522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784404669.331528:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784404669.331534:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728871808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404669.331547:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871936 00000100:00100000:1.0:1784404669.331550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871936 00000100:00100000:0.0:1784404669.331572:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728871808:12345-0@lo:400:kworker.0 Request processed in 38us (6760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404669.331574:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784404669.331578:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404669.331579:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728871936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331600:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871168 00000100:00100000:0.0:1784404669.331603:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871168 00000100:00100000:1.0:1784404669.331604:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728871936:12345-0@lo:400:kworker.0 Request processed in 25us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404669.331609:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784404669.331618:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728871424 00000100:00100000:0.0:1784404669.331620:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728871424 00000100:00080000:1.0:1784404669.331623:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404669.331632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784404669.331638:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728871168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728871168:12345-0@lo:400:kworker.0 Request processed in 35us (7330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404669.331679:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784404669.331690:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784404669.331696:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728871424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331721:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728871424:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404669.331727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784404669.331753:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728870912:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331762:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728871424:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.331769:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728871936:0@lo:400:kworker.0 00010000:00080000:0.0:1784404669.331782:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9ad80 x1871083728871808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404669.331792:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728871808:0@lo:400:kworker.0 00000100:00100000:3.0:1784404669.332418:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728871552:0@lo:400:kworker.0 00000100:00100000:3.0:1784404669.332427:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728872064:0@lo:400:kworker.0 00000100:00100000:3.0:1784404669.332459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784404669.332498:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435d9f80 x1871083728870528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404669.332513:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728870528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404669.332536:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728871040:0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.332581:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872064 00000100:00100000:0.0:1784404669.332600:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872064 00000100:00100000:0.0:1784404669.332645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784404669.332653:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728872064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404669.332694:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728872064:12345-0@lo:400:kworker.0 Request processed in 43us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404669.332700:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1784404669.332725:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9b800 x1871083728872064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404669.332734:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728872064:0@lo:400:kworker.0 00000100:00100000:2.0:1784404669.332786:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728870656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404669.332820:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728871168:0@lo:400:kworker.0 00010000:00080000:2.0:1784404669.332834:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442555c00 x1871083728871680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404669.333062:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728871680:0@lo:400:kworker.0 00000100:00080000:1.0:1784404669.334454:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784404669.699128:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404670.667816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404670.667943:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835392 00000100:00100000:1.0:1784404670.667955:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835392 00000100:00100000:1.0:1784404670.668023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 279 00000100:00100000:1.0:1784404670.668033:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707835392:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404670.668125:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707835392:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 93us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404670.668133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 279 00000100:00100000:1.0:1784404670.669100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404670.670107:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835520 00000100:00100000:3.0:1784404670.670117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835520 00000100:00100000:3.0:1784404670.670266:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 90 00000100:00100000:3.0:1784404670.670277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707835520:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404670.670361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707835520:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 85us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404670.670376:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 90 00000100:00100000:3.0:1784404670.670475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404670.670534:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835648 00000100:00100000:3.0:1784404670.670537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835648 00000100:00080000:1.0:1784404670.673489:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404670.673498:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404670.673690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:3.0:1784404670.673702:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707835648:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404670.673783:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707835648:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 84us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404670.673791:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 91 00000001:02000400:1.0:1784404670.686880:0:11315:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.174 00010000:00010000:1.0:1784404670.724204:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784404670.860986:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:2.0:1784404670.860999:0:9511:0:(genops.c:885:class_export_put()) final put ffff9dd443580800/1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:2.0:1784404670.863111:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443580800/1827e730-172d-4769-8ecb-95f4e65fc8a0 for lustre-OST0001 00000020:00000080:2.0:1784404670.863168:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443586000 for lustre-OST0001 00000001:00100000:2.0:1784404670.864585:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:2.0:1784404670.864593:0:8427:0:(genops.c:885:class_export_put()) final put ffff9dd44333a000/1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:3.0:1784404670.866384:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44333a000/1827e730-172d-4769-8ecb-95f4e65fc8a0 for lustre-OST0000 00000020:00000080:3.0:1784404670.866454:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd44333e000 for lustre-OST0000 00000100:00100000:3.0:1784404670.867209:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404670.867237:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728872192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404670.867324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404670.867394:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872192 00000100:00100000:3.0:1784404670.867402:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872192 00000100:00100000:3.0:1784404670.867446:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784404670.867453:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728872192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404670.867490:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784404670.867529:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728872192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404670.867536:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784404670.867575:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728872192:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784404671.747158:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404671.875226:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728872320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404671.875316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404671.876141:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872320 00000100:00100000:3.0:1784404671.876154:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872320 00000100:00100000:3.0:1784404671.876233:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784404671.876243:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728872320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404671.876281:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404671.876348:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728872320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404671.876355:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784404671.876601:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728872320:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1784404672.079961:0:11363:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Jul 18 15:57:51 EDT 2026 00010000:00010000:0.0:1784404672.771992:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404673.799408:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404674.438456:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728872448:0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.438534:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404674.438580:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728872960:0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.438622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404674.438643:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728873472:0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.438666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.439914:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728872704:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.439964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.439989:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728873216:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440034:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728873728:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440081:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728874240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404674.440105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440130:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1784404674.440137:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728872576:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404674.440172:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728873984:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440174:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728873088:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440207:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728873600:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440237:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728874112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404674.440269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404674.440280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440302:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728872832:0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.440318:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872448 00000100:00100000:3.0:1784404674.440326:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872448 00000100:00100000:2.0:1784404674.440326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440336:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728873344:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440352:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440366:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728873856:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.440385:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404674.440412:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728874240 00000100:00100000:2.0:1784404674.440416:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728874240 00000100:00100000:2.0:1784404674.440457:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728874112 00000100:00100000:2.0:1784404674.440460:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728874112 00000100:00100000:2.0:1784404674.440478:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784404674.440487:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728874240:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404674.440499:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784404674.440505:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728872448:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784404674.440518:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404674.440561:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728872448:12345-0@lo:400:kworker.0 Request processed in 55us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404674.440569:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784404674.440654:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872960 00000100:00100000:0.0:1784404674.440658:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872960 00000100:00100000:0.0:1784404674.440678:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872704 00000100:00100000:0.0:1784404674.440680:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872704 00000100:00100000:0.0:1784404674.440694:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784404674.440700:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728872960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.440963:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873472 00000100:00100000:3.0:1784404674.440968:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873472 00000100:00100000:3.0:1784404674.441373:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873984 00000100:00100000:3.0:1784404674.441379:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873984 00000100:00100000:3.0:1784404674.441410:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873344 00000100:00100000:3.0:1784404674.441413:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873344 00000100:00100000:3.0:1784404674.441424:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873856 00000100:00100000:3.0:1784404674.441426:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873856 00000100:00100000:3.0:1784404674.441437:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784404674.441443:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728873472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.442322:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728874240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1833us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.442336:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784404674.442357:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784404674.442364:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728874112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404674.442383:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404674.442472:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728874112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.442478:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1784404674.442496:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404674.442501:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784404674.442539:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e4a80 x1871083728874112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404674.442559:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728874112:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1784404674.442573:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443528700 x1871083728874240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404674.442584:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728874240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404674.446260:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873216 00000100:00100000:2.0:1784404674.446281:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873216 00000100:00100000:2.0:1784404674.446347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873728 00000100:00100000:2.0:1784404674.446353:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873728 00000100:00100000:2.0:1784404674.446369:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872576 00000100:00100000:2.0:1784404674.446371:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872576 00000100:00100000:2.0:1784404674.446379:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873088 00000100:00100000:2.0:1784404674.446381:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873088 00000100:00100000:2.0:1784404674.446391:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728873600 00000100:00100000:2.0:1784404674.446393:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728873600 00000100:00100000:2.0:1784404674.446401:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728872832 00000100:00100000:2.0:1784404674.446403:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728872832 00000100:00100000:2.0:1784404674.446431:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784404674.446438:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728873216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446528:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728873216:12345-0@lo:400:kworker.0 Request processed in 87us (6510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.446535:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784404674.446552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784404674.446558:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728873728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446581:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728873728:12345-0@lo:400:kworker.0 Request processed in 24us (6526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.446586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784404674.446596:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784404674.446601:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728872576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446628:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728872576:12345-0@lo:400:kworker.0 Request processed in 26us (6469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.446635:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784404674.446645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784404674.446651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728873088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446677:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728873088:12345-0@lo:400:kworker.0 Request processed in 26us (6484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.446683:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784404674.446694:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784404674.446700:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728873600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446730:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728873600:12345-0@lo:400:kworker.0 Request processed in 30us (6502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.446735:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784404674.446753:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784404674.446759:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728872832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446791:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728872832:12345-0@lo:400:kworker.0 Request processed in 32us (6463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404674.446796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1784404674.446826:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404674.446830:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404674.446879:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728872576:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446893:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728873088:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.446915:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728873600:0@lo:400:kworker.0 00010000:00080000:2.0:1784404674.446928:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1f800 x1871083728873216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404674.446939:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728873216:0@lo:400:kworker.0 00010000:00080000:2.0:1784404674.446951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1df80 x1871083728873728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404674.446960:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728873728:0@lo:400:kworker.0 00000100:00100000:0.0:1784404674.453318:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728872960:12345-0@lo:400:kworker.0 Request processed in 12604us (14681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404674.453334:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784404674.453542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784404674.453557:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728872704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.453679:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728873472:12345-0@lo:400:kworker.0 Request processed in 12233us (15008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404674.453735:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784404674.453921:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784404674.453933:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728873984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.456771:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728873984:12345-0@lo:400:kworker.0 Request processed in 2832us (16480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404674.456786:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784404674.459039:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784404674.459061:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728873344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.459151:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728872448:0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.459353:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728873344:12345-0@lo:400:kworker.0 Request processed in 302us (18998us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404674.459361:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784404674.459376:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784404674.459383:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728873856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.459415:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728873856:12345-0@lo:400:kworker.0 Request processed in 33us (19028us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404674.459421:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784404674.460970:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728872960:0@lo:400:kworker.0 00010000:00080000:2.0:1784404674.460995:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1ed80 x1871083728873472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404674.461007:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728873472:0@lo:400:kworker.0 00010000:00080000:2.0:1784404674.461021:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1c380 x1871083728873984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404674.461050:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728873984:0@lo:400:kworker.0 00000100:00100000:2.0:1784404674.461077:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404674.461086:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728874368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404674.461129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404674.461168:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728874368 00000100:00100000:3.0:1784404674.461176:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728874368 00000100:00100000:3.0:1784404674.461233:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784404674.461251:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728874368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404674.461277:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404674.461320:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728874368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404674.461327:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1784404674.462034:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca19c00 x1871083728874368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404674.462048:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728874368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404674.462332:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728872704:12345-0@lo:400:kworker.0 Request processed in 8780us (22366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404674.462351:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784404674.462469:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728874496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404674.462472:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728872832:0@lo:400:kworker.0 00010000:00080000:0.0:1784404674.462484:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1f480 x1871083728873344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404674.462502:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404674.462508:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728873344:0@lo:400:kworker.0 00010000:00080000:0.0:1784404674.462533:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1c000 x1871083728873856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404674.462541:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728874496 00000100:00100000:0.0:1784404674.462542:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728873856:0@lo:400:kworker.0 00000100:00100000:3.0:1784404674.462555:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728874496 00000100:00100000:3.0:1784404674.462598:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784404674.462607:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728874496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784404674.462622:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404674.462658:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728874496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404674.462664:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1784404674.462703:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca18e00 x1871083728874496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404674.462715:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728874496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404674.469196:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728872704:0@lo:400:kworker.0 00010000:00010000:0.0:1784404674.820129:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404675.793496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404675.793543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404675.793587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404675.793733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835904 00000100:00100000:0.0:1784404675.793744:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835904 00000100:00100000:0.0:1784404675.793810:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836032 00000100:00100000:0.0:1784404675.793813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836032 00000100:00100000:0.0:1784404675.793837:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:0.0:1784404675.793847:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707835904:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404675.793992:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707835904:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 146us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404675.794000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:0.0:1784404675.794020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00100000:0.0:1784404675.794026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707836032:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404675.794049:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707836032:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404675.794055:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00080000:3.0:1784404675.794194:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404675.794199:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404675.794751:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707835776 00000100:00100000:1.0:1784404675.794759:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707835776 00000100:00100000:1.0:1784404675.794818:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 281 00000100:00100000:1.0:1784404675.794827:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707835776:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404675.795045:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2403:x1871083707835776:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 219us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404675.795059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 281 00010000:00010000:0.0:1784404675.843318:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404675.971381:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404675.971406:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728874624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404675.971478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404675.971643:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728874624 00000100:00100000:0.0:1784404675.971652:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728874624 00000100:00100000:0.0:1784404675.971712:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784404675.971731:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728874624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404675.971777:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404675.971846:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728874624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404675.971898:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784404675.972173:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728874624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784404676.876007:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404677.003808:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404677.003833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728874752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404677.003939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404677.004133:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728874752 00000100:00100000:0.0:1784404677.004141:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728874752 00000100:00100000:0.0:1784404677.004204:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784404677.004214:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728874752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404677.004249:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784404677.004917:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728874752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 634us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404677.004927:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784404677.005038:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728874752:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784404677.898369:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404678.916358:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404679.555004:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728875008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404679.555078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404679.555123:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875008 00000100:00100000:2.0:1784404679.555131:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875008 00000100:00100000:0.0:1784404679.555132:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728874880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404679.555154:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404679.555183:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728874880 00000100:00100000:0.0:1784404679.555186:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728874880 00000100:00100000:2.0:1784404679.555195:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404679.555204:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728875008:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404679.555205:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784404679.555210:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728874880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404679.555229:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784404679.555229:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404679.555277:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728875008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.555284:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1784404679.555304:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404679.555305:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728875136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404679.555333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404679.555406:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875136 00000100:00100000:2.0:1784404679.555410:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875136 00000100:00100000:2.0:1784404679.555432:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784404679.555438:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728875136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404679.555452:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404679.555481:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728875136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.555492:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784404679.555535:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728875264:0@lo:400:kworker.0 00000100:00100000:3.0:1784404679.555569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404679.555594:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728875776:0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.555697:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728875392:0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.555706:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728875648:0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.555726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404679.555753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404679.555766:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728875904:0@lo:400:kworker.0 00000100:00100000:3.0:1784404679.555768:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728876288:0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.555794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875264 00000100:00100000:2.0:1784404679.555798:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875264 00000100:00100000:3.0:1784404679.555800:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404679.555824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784404679.555830:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728875264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404679.555832:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875776 00000100:00100000:3.0:1784404679.555834:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875776 00000100:00100000:2.0:1784404679.555894:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728875264:12345-0@lo:400:kworker.0 Request processed in 64us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.555901:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784404679.555919:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875392 00000100:00100000:1.0:1784404679.555922:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875392 00000100:00080000:2.0:1784404679.555926:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404679.555933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404679.555950:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728876416:0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.555962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876288 00000100:00100000:1.0:1784404679.555965:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876288 00000100:00100000:2.0:1784404679.555973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404679.555984:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875904 00000100:00100000:1.0:1784404679.555986:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875904 00000100:00100000:1.0:1784404679.555999:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784404679.556005:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728875392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.556050:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728875392:12345-0@lo:400:kworker.0 Request processed in 45us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404679.556104:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784404679.556112:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728875776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.556128:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784404679.556136:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728876288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404679.556144:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728875776:12345-0@lo:400:kworker.0 Request processed in 34us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404679.556150:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784404679.556233:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728876288:12345-0@lo:400:kworker.0 Request processed in 98us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.556239:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784404679.556253:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784404679.556258:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728875904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.556282:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728875904:12345-0@lo:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.556296:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784404679.556317:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876416 00000100:00100000:2.0:1784404679.556320:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876416 00000100:00100000:2.0:1784404679.556348:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784404679.556354:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728876416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.556383:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728876416:12345-0@lo:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.556389:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784404679.556425:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728875264:0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.556437:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728875776:0@lo:400:kworker.0 00010000:00080000:2.0:1784404679.556450:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1f800 x1871083728876288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404679.556460:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728876288:0@lo:400:kworker.0 00000100:00100000:0.0:1784404679.556931:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728874880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1717us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404679.556939:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784404679.556975:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728875520:0@lo:400:kworker.0 00000100:00100000:0.0:1784404679.557005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404679.557023:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728876032:0@lo:400:kworker.0 00000100:00100000:0.0:1784404679.557045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404679.557059:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728876544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404679.557080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784404679.557104:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f90000 x1871083728875008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404679.557119:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728875008:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1784404679.557131:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca19880 x1871083728874880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404679.557142:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728874880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404679.557243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784404679.557264:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876032 00000100:00100000:1.0:1784404679.557268:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876032 00000100:00100000:1.0:1784404679.557296:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784404679.557303:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728876032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.557340:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728876032:12345-0@lo:400:kworker.0 Request processed in 38us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404679.557346:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784404679.557370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404679.557387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728876160:0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.557406:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784404679.557428:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44352b480 x1871083728875136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404679.557440:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728875136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404679.557458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875648 00000100:00100000:1.0:1784404679.557461:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875648 00000100:00100000:1.0:1784404679.557480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876160 00000100:00100000:1.0:1784404679.557483:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876160 00000100:00100000:1.0:1784404679.557511:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784404679.557518:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728875648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.558077:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728875648:12345-0@lo:400:kworker.0 Request processed in 557us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404679.558084:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784404679.558100:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784404679.558106:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728876160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.558136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728876160:12345-0@lo:400:kworker.0 Request processed in 31us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404679.558163:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1784404679.558182:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404679.558188:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404679.558190:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404679.558218:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728875392:0@lo:400:kworker.0 00000100:00100000:1.0:1784404679.558230:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728875904:0@lo:400:kworker.0 00010000:00080000:1.0:1784404679.558242:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1f100 x1871083728876416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404679.558251:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728876416:0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.558252:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728875520 00000100:00100000:2.0:1784404679.558256:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728875520 00000100:00100000:2.0:1784404679.558284:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784404679.558291:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728875520:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1784404679.558293:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1ed80 x1871083728876032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404679.558301:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728876032:0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.558329:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728875520:12345-0@lo:400:kworker.0 Request processed in 39us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.558335:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784404679.558335:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728875520:0@lo:400:kworker.0 00000100:00100000:2.0:1784404679.558357:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876544 00000100:00100000:2.0:1784404679.558360:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876544 00000100:00100000:2.0:1784404679.558390:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784404679.558397:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728876544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404679.558418:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404679.558449:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728876544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404679.558456:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784404679.558471:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728875648:0@lo:400:kworker.0 00000100:00100000:0.0:1784404679.558480:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728876160:0@lo:400:kworker.0 00010000:00080000:1.0:1784404679.559032:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44352ad80 x1871083728876544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404679.559047:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728876544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784404679.939176:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404680.918448:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404680.918483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404680.918509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836160 00000100:00100000:1.0:1784404680.918519:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836160 00000100:00100000:2.0:1784404680.918597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404680.918620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 283 00000100:00100000:1.0:1784404680.918629:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2402:x1871083707836160:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404680.918704:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2402:x1871083707836160:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404680.918712:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836416 00000100:00100000:3.0:1784404680.918717:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836416 00000100:00100000:1.0:1784404680.918728:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 283 00000100:00100000:3.0:1784404680.918755:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836288 00000100:00100000:3.0:1784404680.918758:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836288 00000100:00100000:3.0:1784404680.918784:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 106 00000100:00100000:3.0:1784404680.918792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707836416:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404680.919017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:1.0:1784404680.919026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2402:x1871083707836288:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:0.0:1784404680.920574:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404680.920581:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404680.921339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707836416:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 2539us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404680.921351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 106 00000100:00100000:1.0:1784404680.921429:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2402:x1871083707836288:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 2402us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404680.921437:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 107 00010000:00010000:0.0:1784404680.966575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404681.092108:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728876672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404681.092197:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404681.092311:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876672 00000100:00100000:0.0:1784404681.092319:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876672 00000100:00100000:0.0:1784404681.092380:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784404681.092452:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728876672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404681.092495:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404681.092612:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728876672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 222us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404681.092619:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784404681.092696:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728876672:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784404681.992104:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404682.116112:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784404682.116140:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728876800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404682.116207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404682.116305:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876800 00000100:00100000:0.0:1784404682.116312:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876800 00000100:00100000:0.0:1784404682.116372:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784404682.116381:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728876800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404682.116413:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784404682.116462:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728876800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404682.116469:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784404682.116511:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728876800:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784404683.012081:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404684.037767:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404684.675183:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728876928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404684.675264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404684.675407:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728876928 00000100:00100000:1.0:1784404684.675415:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728876928 00000100:00100000:1.0:1784404684.675472:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784404684.675482:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728876928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784404684.675510:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404684.675555:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728876928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404684.675563:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784404684.675586:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728877056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404684.675611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784404684.675642:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404684.675652:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877056 00000100:00100000:1.0:1784404684.675655:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877056 00000100:00100000:1.0:1784404684.675681:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784404684.675700:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728877056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404684.675717:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404684.675750:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728877056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404684.675757:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1784404684.675774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784404684.675797:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443529500 x1871083728877056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404684.675830:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728877056:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1784404684.675884:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca19880 x1871083728876928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404684.675896:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728876928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404684.676116:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404684.676125:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728877312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404684.676155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404684.676228:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877312 00000100:00100000:2.0:1784404684.676233:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877312 00000100:00100000:2.0:1784404684.676272:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784404684.676279:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728877312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404684.676291:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404684.676324:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728877312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404684.676330:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1784404684.676383:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784404684.676405:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f92680 x1871083728877312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404684.676417:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728877312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404684.676467:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728877184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404684.676495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404684.676534:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877184 00000100:00100000:1.0:1784404684.676538:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877184 00000100:00100000:1.0:1784404684.676577:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784404684.676584:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728877184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784404684.676594:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404684.676624:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728877184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404684.676630:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1784404684.676653:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca19880 x1871083728877184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404684.676666:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728877184:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784404684.676761:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404684.677080:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728877440:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404684.677146:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728877952:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404684.677200:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728878464:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404684.677244:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784404684.677251:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728877824:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404684.677291:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728878336:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404684.677337:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877952 00000100:00100000:0.0:1784404684.677341:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877952 00000100:00100000:0.0:1784404684.677369:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784404684.677376:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728877952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677416:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728877952:12345-0@lo:400:kworker.0 Request processed in 41us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404684.677423:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784404684.677443:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878464 00000100:00100000:0.0:1784404684.677446:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878464 00000100:00100000:0.0:1784404684.677475:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877824 00000100:00100000:0.0:1784404684.677478:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877824 00000100:00100000:0.0:1784404684.677488:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878336 00000100:00100000:0.0:1784404684.677491:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878336 00000100:00100000:0.0:1784404684.677504:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784404684.677510:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728878464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677541:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728878464:12345-0@lo:400:kworker.0 Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404684.677547:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784404684.677559:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784404684.677571:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728877824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677600:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728877824:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404684.677607:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784404684.677618:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784404684.677624:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728878336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677649:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728878336:12345-0@lo:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404684.677655:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1784404684.677672:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404684.677675:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404684.677695:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728877824:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677705:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728878336:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.677713:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728877952:0@lo:400:kworker.0 00010000:00080000:0.0:1784404684.677723:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1df80 x1871083728878464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404684.677732:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728878464:0@lo:400:kworker.0 00000100:00100000:2.0:1784404684.677802:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877440 00000100:00100000:2.0:1784404684.677817:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877440 00000100:00100000:2.0:1784404684.677877:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784404684.677886:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728877440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404684.677925:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728877440:12345-0@lo:400:kworker.0 Request processed in 41us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404684.677932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784404684.678039:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728877440:0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.678982:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728877696:0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679035:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404684.679067:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728878208:0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404684.679129:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784404684.679136:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728877568:0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404684.679179:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728878080:0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679200:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404684.679232:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878208 00000100:00100000:1.0:1784404684.679239:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878208 00000100:00100000:1.0:1784404684.679281:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877568 00000100:00100000:1.0:1784404684.679284:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877568 00000100:00100000:1.0:1784404684.679297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878080 00000100:00100000:1.0:1784404684.679300:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878080 00000100:00100000:1.0:1784404684.679325:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784404684.679334:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728878208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679384:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728878208:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404684.679391:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784404684.679407:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784404684.679413:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728877568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679441:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728877568:12345-0@lo:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404684.679447:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784404684.679459:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784404684.679476:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728878080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679506:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728878080:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404684.679512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1784404684.679535:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404684.679540:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404684.679570:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728877568:0@lo:400:kworker.0 00000100:00100000:1.0:1784404684.679579:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728878080:0@lo:400:kworker.0 00010000:00080000:1.0:1784404684.679590:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f92680 x1871083728878208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404684.679599:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728878208:0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.680361:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728877696 00000100:00100000:0.0:1784404684.680368:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728877696 00000100:00100000:0.0:1784404684.680409:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784404684.680418:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728877696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404684.680476:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728877696:12345-0@lo:400:kworker.0 Request processed in 60us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404684.680507:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784404684.680635:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728877696:0@lo:400:kworker.0 00010000:00010000:2.0:1784404685.059090:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404686.032643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404686.032693:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404686.032771:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404686.032922:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836672 00000100:00100000:1.0:1784404686.032933:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836672 00000100:00100000:1.0:1784404686.033001:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836800 00000100:00100000:1.0:1784404686.033005:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836800 00000100:00100000:1.0:1784404686.033031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:1.0:1784404686.033041:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707836672:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404686.033124:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707836672:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 84us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404686.033131:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:1.0:1784404686.033149:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:1.0:1784404686.033156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707836800:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404686.033181:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707836800:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404686.033202:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00080000:0.0:1784404686.033457:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404686.033462:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404686.036693:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836544 00000100:00100000:3.0:1784404686.036710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836544 00000100:00100000:3.0:1784404686.036808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 285 00000100:00100000:3.0:1784404686.036821:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2404:x1871083707836544:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404686.036932:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2404:x1871083707836544:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 113us (4237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404686.036941:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 285 00010000:00010000:0.0:1784404686.084013:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404686.212996:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404686.213023:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728878592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404686.213103:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404686.219584:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878592 00000100:00100000:0.0:1784404686.219601:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878592 00000100:00100000:0.0:1784404686.219669:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784404686.219681:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728878592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404686.219717:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404686.219815:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728878592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (6711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404686.219823:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784404686.219894:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728878592:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1784404686.456532:0:11992:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:58:05 (1784404685) === 00000100:00100000:0.0:1784404686.856088:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404686.856269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707836928 00000100:00100000:2.0:1784404686.856280:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707836928 00000100:00100000:2.0:1784404686.856347:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 286 00000100:00100000:2.0:1784404686.856359:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:8724:x1871083707836928:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784404686.856375:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404686.856395:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541390000/0x24b3e2e6dcd78e53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed70e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.856424:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541390000/0x24b3e2e6dcd78e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70e0 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.856436:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541390000/0x24b3e2e6dcd78e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70e0 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.856446:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541390000, rc 0) 00000100:00100000:2.0:1784404686.856520:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8724:x1871083707836928:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 163us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404686.856535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 286 00000100:00100000:3.0:1784404686.870642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404686.872253:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837056 00000100:00100000:1.0:1784404686.872266:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837056 00000100:00100000:1.0:1784404686.872336:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 287 00000100:00100000:1.0:1784404686.872354:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8724:x1871083707837056:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784404686.872504:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8724:x1871083707837056:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 152us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404686.872512:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 287 00000100:00100000:1.0:1784404686.881174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404686.882497:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837184 00000100:00100000:3.0:1784404686.882511:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837184 00000100:00100000:3.0:1784404686.882587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 288 00000100:00100000:3.0:1784404686.882598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8724:x1871083707837184:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784404686.882793:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8724:x1871083707837184:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 187us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404686.882801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 288 00000100:00100000:0.0:1784404686.885634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404686.886367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837312 00000100:00100000:2.0:1784404686.886377:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837312 00000100:00100000:2.0:1784404686.886441:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 289 00000100:00100000:2.0:1784404686.886454:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8728:x1871083707837312:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784404686.886685:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8728:x1871083707837312:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 233us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404686.886693:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 289 00000100:00100000:0.0:1784404686.910773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404686.910893:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837440 00000100:00100000:1.0:1784404686.910904:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837440 00000100:00100000:1.0:1784404686.910971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 290 00000100:00100000:1.0:1784404686.910982:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8728:x1871083707837440:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784404686.911138:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8728:x1871083707837440:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 157us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404686.911146:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 290 00000100:00100000:1.0:1784404686.916085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404686.917013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837568 00000100:00100000:3.0:1784404686.917024:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837568 00000100:00100000:3.0:1784404686.917141:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 291 00000100:00100000:3.0:1784404686.917164:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8728:x1871083707837568:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784404686.917349:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8728:x1871083707837568:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 187us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404686.917363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 291 00000100:00100000:0.0:1784404686.924143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404686.924265:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837696 00000100:00100000:2.0:1784404686.924276:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837696 00000100:00100000:2.0:1784404686.924389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 292 00000100:00100000:2.0:1784404686.924411:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:8724:x1871083707837696:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784404686.924425:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404686.924439:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541390e00/0x24b3e2e6dcd78e5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7111 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.924460:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541390e00/0x24b3e2e6dcd78e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7111 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.924468:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541390e00/0x24b3e2e6dcd78e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7111 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.924484:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541390e00, rc 0) 00000100:00100000:2.0:1784404686.924534:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:8724:x1871083707837696:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 124us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404686.924540:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 292 00000100:00100000:0.0:1784404686.929744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404686.930107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837824 00000100:00100000:3.0:1784404686.930116:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837824 00000100:00100000:0.0:1784404686.930319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 293 00000100:00100000:0.0:1784404686.930329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:8724:x1871083707837824:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784404686.930352:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784404686.930377:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784404686.930381:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784404686.930388:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784404686.930391:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784404686.930393:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1784404686.933491:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:8724:x1871083707837824:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 3151us (3743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404686.933507:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 293 00000100:00100000:1.0:1784404686.938892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404686.939835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707837952 00000100:00100000:2.0:1784404686.939848:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707837952 00000100:00100000:2.0:1784404686.939954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 294 00000100:00100000:2.0:1784404686.939966:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:8724:x1871083707837952:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784404686.939983:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404686.940003:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7118 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.940059:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.940069:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404686.940098:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391800, rc 0) 00000100:00100000:2.0:1784404686.940184:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8724:x1871083707837952:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 220us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404686.940191:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 294 00000100:00100000:3.0:1784404686.946681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404686.946752:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838080 00000100:00100000:0.0:1784404686.946760:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838080 00000100:00100000:0.0:1784404686.946818:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 295 00000100:00100000:0.0:1784404686.947090:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8724:x1871083707838080:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784404686.947544:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8724:x1871083707838080:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 717us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404686.947551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 295 00000100:00100000:1.0:1784404686.955552:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404686.955655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838208 00000100:00100000:2.0:1784404686.955665:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838208 00000100:00100000:2.0:1784404686.955802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 296 00000100:00100000:2.0:1784404686.955813:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8724:x1871083707838208:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784404686.956294:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8724:x1871083707838208:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 481us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404686.956302:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 296 00000100:00100000:1.0:1784404686.965684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404686.968066:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838336 00000100:00100000:0.0:1784404686.968083:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838336 00000100:00100000:0.0:1784404686.968203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 297 00000100:00100000:0.0:1784404686.968215:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8732:x1871083707838336:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784404686.968403:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8732:x1871083707838336:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 190us (2727us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404686.968412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 297 00000100:00100000:3.0:1784404686.973768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404686.979871:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838464 00000100:00100000:1.0:1784404686.979886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838464 00000100:00100000:1.0:1784404686.979956:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 298 00000100:00100000:1.0:1784404686.979968:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8732:x1871083707838464:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784404686.980124:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:8732:x1871083707838464:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 158us (6370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404686.980133:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 298 00000100:00100000:2.0:1784404686.985223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404686.985280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404686.985368:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838720 00000100:00100000:3.0:1784404686.985379:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838720 00000100:00100000:3.0:1784404686.985438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838848 00000100:00100000:3.0:1784404686.985442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838848 00000100:00100000:3.0:1784404686.985476:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:3.0:1784404686.985487:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707838720:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404686.985560:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:0.0:1784404686.985571:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707838848:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404686.985668:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707838720:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 181us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404686.985676:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:0.0:1784404686.991144:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707838848:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 5559us (5847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404686.991162:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:2.0:1784404686.993306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404686.993409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404686.993493:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838592 00000100:00100000:0.0:1784404686.993504:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838592 00000100:00100000:0.0:1784404686.993545:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707839104 00000100:00100000:0.0:1784404686.993605:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707839104 00000100:00100000:0.0:1784404686.993635:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1784404686.993645:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1871083707838592:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784404686.993685:0:6519:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 699a5e6e-e921-4091-819a-62d5132b8ddf@192.168.202.42@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:0.0:1784404686.993721:0:6519:0:(genops.c:1385:class_connect()) connect: client 699a5e6e-e921-4091-819a-62d5132b8ddf, cookie 0x24b3e2e6dcd78e68 00000004:00100000:0.0:1784404686.993749:0:6519:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784404686.993803:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:2.0:1784404686.993810:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1871083707839104:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784404686.993826:0:9527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 699a5e6e-e921-4091-819a-62d5132b8ddf@192.168.202.42@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1784404686.993868:0:9527:0:(genops.c:1385:class_connect()) connect: client 699a5e6e-e921-4091-819a-62d5132b8ddf, cookie 0x24b3e2e6dcd78e6f 00000004:00100000:2.0:1784404686.993883:0:9527:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784404686.993901:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9dd574f27800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404686.993974:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2400:x1871083707838592:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 329us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404686.993982:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00080000:2.0:1784404686.994100:0:9527:0:(import.c:65:import_set_state_nolock()) ffff9dd443686000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404686.994127:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2400:x1871083707839104:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 315us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404686.994133:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:2.0:1784404687.003663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404687.003711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404687.003756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404687.003892:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707839232 00000100:00100000:1.0:1784404687.003907:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707839232 00000100:00100000:1.0:1784404687.004010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707838976 00000100:00100000:1.0:1784404687.004014:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707838976 00000100:00100000:1.0:1784404687.004039:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707839360 00000100:00100000:1.0:1784404687.004042:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707839360 00000100:00100000:1.0:1784404687.004060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404687.004072:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+6:0:x1871083707839232:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404687.004119:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784404687.004214:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+6:0:x1871083707839232:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 144us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404687.004222:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404687.004243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1784404687.004249:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+7:0:x1871083707838976:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404687.004269:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784404687.004304:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+7:0:x1871083707838976:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 55us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404687.004310:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1784404687.004321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784404687.004327:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707839360:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404687.004336:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784404687.004356:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707839360:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404687.004375:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00080000:2.0:1784404687.004633:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404687.004639:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404687.010113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404687.015646:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707839488 00000100:00100000:0.0:1784404687.015663:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707839488 00000100:00100000:0.0:1784404687.015742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1784404687.015753:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707839488:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784404687.016748:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707839488:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 991us (6641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404687.016759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784404687.020134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404687.020216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404687.020533:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707839616 00000100:00100000:0.0:1784404687.020545:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707839616 00000100:00100000:0.0:1784404687.020593:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707839744 00000100:00100000:0.0:1784404687.020597:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707839744 00000100:00100000:0.0:1784404687.020627:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1784404687.020635:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57cb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1871083707839616:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784404687.020668:0:8488:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 699a5e6e-e921-4091-819a-62d5132b8ddf@192.168.202.42@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:0.0:1784404687.020701:0:8488:0:(genops.c:1385:class_connect()) connect: client 699a5e6e-e921-4091-819a-62d5132b8ddf, cookie 0x24b3e2e6dcd78e76 00002000:00100000:0.0:1784404687.020713:0:8488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 699a5e6e-e921-4091-819a-62d5132b8ddf/ffff9dd574f22800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784404687.020747:0:8488:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784404687.020939:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784404687.020944:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1871083707839744:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784404687.020962:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 699a5e6e-e921-4091-819a-62d5132b8ddf@192.168.202.42@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1784404687.020979:0:8433:0:(genops.c:1385:class_connect()) connect: client 699a5e6e-e921-4091-819a-62d5132b8ddf, cookie 0x24b3e2e6dcd78e7d 00002000:00100000:2.0:1784404687.020985:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 699a5e6e-e921-4091-819a-62d5132b8ddf/ffff9dd443680000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784404687.020996:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784404687.021037:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784404687.021070:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9dd443682800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404687.021134:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2400:x1871083707839744:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 187us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404687.021142:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00002000:00080000:0.0:1784404687.021878:0:8488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784404687.022616:0:8488:0:(import.c:65:import_set_state_nolock()) ffff9dd577f5d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404687.022740:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57cb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2400:x1871083707839616:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 2047us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404687.022751:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:2.0:1784404687.024451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404687.024578:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707839872 00000100:00100000:0.0:1784404687.024587:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707839872 00000100:00100000:0.0:1784404687.024645:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1784404687.024654:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707839872:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784404687.024728:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707839872:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 75us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404687.024736:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1784404687.027115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404687.027215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840000 00000100:00100000:2.0:1784404687.027224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840000 00000100:00100000:2.0:1784404687.027279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:2.0:1784404687.027290:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707840000:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784404687.027398:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784404687.027495:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:8724:x1871083707840000:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 206us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404687.027502:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00010000:00010000:0.0:1784404687.107482:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404687.235907:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728878720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404687.235992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404687.236222:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878720 00000100:00100000:1.0:1784404687.236232:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878720 00000100:00100000:1.0:1784404687.236292:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784404687.236303:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728878720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404687.236349:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784404687.241777:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728878720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5465us (5774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404687.241801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784404687.242205:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728878720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784404688.131399:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404689.156073:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404689.795512:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728878848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404689.795642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.795706:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404689.795712:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728878976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404689.795736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.795776:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878848 00000100:00100000:3.0:1784404689.795785:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878848 00000100:00100000:3.0:1784404689.795839:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728878976 00000100:00100000:3.0:1784404689.795843:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728878976 00000100:00100000:3.0:1784404689.795899:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404689.795908:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728878848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404689.795935:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404689.795979:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728878848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.795987:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404689.796003:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784404689.796009:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728878976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404689.796024:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404689.796047:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728878976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.796053:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1784404689.796066:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404689.796070:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404689.796092:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242d880 x1871083728878976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404689.796109:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728878976:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784404689.796119:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea0a80 x1871083728878848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404689.796129:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728878848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404689.796419:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728879104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404689.796449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404689.796470:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404689.796476:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728879232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404689.796495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404689.796525:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728879104 00000100:00100000:0.0:1784404689.796528:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728879104 00000100:00100000:0.0:1784404689.796554:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728879232 00000100:00100000:0.0:1784404689.796557:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728879232 00000100:00100000:0.0:1784404689.796570:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784404689.796577:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728879104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404689.796587:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404689.796617:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728879104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404689.796622:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784404689.796643:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784404689.796649:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728879232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784404689.796660:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404689.796684:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728879232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404689.796690:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1784404689.796703:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404689.796706:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784404689.796723:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f93b80 x1871083728879232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404689.796737:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728879232:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1784404689.796748:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f92300 x1871083728879104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404689.796767:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728879104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404689.799305:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728879744:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.799411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.799461:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728880256:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.799485:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.799527:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784404689.799533:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728879616:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.799558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.799576:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728880128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.799612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.799657:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728879744 00000100:00100000:3.0:1784404689.799665:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728879744 00000100:00100000:3.0:1784404689.799704:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880256 00000100:00100000:3.0:1784404689.799708:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880256 00000100:00100000:3.0:1784404689.799728:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880128 00000100:00100000:3.0:1784404689.799731:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880128 00000100:00100000:3.0:1784404689.799747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784404689.799755:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728879744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.799828:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728879744:12345-0@lo:400:kworker.0 Request processed in 60us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.799836:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784404689.799873:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784404689.799880:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728880256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.799906:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728880256:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.799912:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784404689.799922:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784404689.799927:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728880128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.799953:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728880128:12345-0@lo:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.799958:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784404689.799976:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728879616 00000100:00100000:3.0:1784404689.799985:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728879616 00000100:00100000:3.0:1784404689.800012:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784404689.800018:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728879616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800049:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728879616:12345-0@lo:400:kworker.0 Request processed in 32us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.800054:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784404689.800081:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728879488:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.800143:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728880000:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.800179:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784404689.800185:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728879360:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.800230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728879872:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.800265:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728880384:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404689.800308:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728879360 00000100:00100000:3.0:1784404689.800312:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728879360 00000100:00100000:3.0:1784404689.800337:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784404689.800344:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728879360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800376:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728879360:12345-0@lo:400:kworker.0 Request processed in 32us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.800382:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784404689.800405:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728879488 00000100:00100000:3.0:1784404689.800409:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728879488 00000100:00100000:3.0:1784404689.800430:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880000 00000100:00100000:3.0:1784404689.800433:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880000 00000100:00100000:3.0:1784404689.800444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880384 00000100:00100000:3.0:1784404689.800446:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880384 00000100:00100000:3.0:1784404689.800456:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784404689.800461:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728879488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800490:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728879488:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.800497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784404689.800507:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784404689.800513:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728880000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728880000:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.800544:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784404689.800554:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784404689.800560:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728880384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800584:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728880384:12345-0@lo:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.800590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784404689.800607:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728879872 00000100:00100000:3.0:1784404689.800610:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728879872 00000100:00100000:3.0:1784404689.800629:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784404689.800634:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728879872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800661:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728879872:12345-0@lo:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404689.800667:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784404689.800697:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728879360:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800717:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728879872:0@lo:400:kworker.0 00010000:00080000:3.0:1784404689.800729:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242d180 x1871083728880384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404689.800739:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728880384:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800748:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728879488:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728880000:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800807:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728879616:0@lo:400:kworker.0 00010000:00080000:3.0:1784404689.800818:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242c000 x1871083728880128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404689.800826:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728880128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800836:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728879744:0@lo:400:kworker.0 00000100:00100000:3.0:1784404689.800844:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728880256:0@lo:400:kworker.0 00000100:00080000:0.0:1784404689.801729:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404689.801735:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784404690.180065:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404691.203225:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404691.331126:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728880512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404691.331208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404691.331358:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880512 00000100:00100000:0.0:1784404691.331368:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880512 00000100:00100000:0.0:1784404691.331424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784404691.331434:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728880512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404691.331471:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404691.331534:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728880512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404691.331541:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784404691.331604:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728880512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404692.176623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404692.176788:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840256 00000100:00100000:0.0:1784404692.176806:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840256 00000100:00100000:0.0:1784404692.176912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:0.0:1784404692.176923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707840256:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404692.177007:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707840256:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 86us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404692.177015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00080000:1.0:1784404692.177318:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404692.185940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404692.185987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404692.186022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404692.186050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404692.186078:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840384 00000100:00100000:0.0:1784404692.186086:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840384 00000100:00100000:0.0:1784404692.186139:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840640 00000100:00100000:0.0:1784404692.186142:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840640 00000100:00100000:0.0:1784404692.186163:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:0.0:1784404692.186172:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707840384:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404692.186244:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707840384:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404692.186252:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:0.0:1784404692.186267:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:0.0:1784404692.186273:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2404:x1871083707840640:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404692.186295:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2404:x1871083707840640:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404692.186299:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:0.0:1784404692.186315:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840896 00000100:00100000:0.0:1784404692.186318:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840896 00000100:00100000:0.0:1784404692.186354:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:0.0:1784404692.186359:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2404:x1871083707840896:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404692.186382:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2404:x1871083707840896:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404692.186387:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00080000:0.0:1784404692.186406:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404692.186410:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404692.186607:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840128 00000100:00100000:2.0:1784404692.186612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840128 00000100:00100000:2.0:1784404692.186649:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 300 00000100:00100000:2.0:1784404692.186656:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707840128:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404692.186689:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707840128:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404692.186695:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 300 00000100:00100000:1.0:1784404692.206422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404692.206480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404692.206553:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840768 00000100:00100000:3.0:1784404692.206561:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840768 00000100:00100000:3.0:1784404692.206640:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:3.0:1784404692.206652:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707840768:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404692.206752:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707840768:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404692.206761:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00080000:1.0:1784404692.207231:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404692.207289:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707840512 00000100:00100000:0.0:1784404692.207294:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707840512 00000100:00100000:0.0:1784404692.207351:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:0.0:1784404692.207359:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707840512:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404692.207410:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707840512:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 52us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404692.207417:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00080000:1.0:1784404692.207788:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784404692.227678:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404692.360602:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728880640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404692.360676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404692.360764:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880640 00000100:00100000:3.0:1784404692.360772:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880640 00000100:00100000:3.0:1784404692.360820:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784404692.360830:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728880640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404692.360889:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404692.360935:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728880640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404692.360943:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784404692.360990:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728880640:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1784404692.642307:0:12185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:0.0:1784404692.875528:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00100000:0.0:1784404692.876066:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00100000:2.0:1784404692.880375:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00100000:2.0:1784404692.880624:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00010000:00010000:2.0:1784404693.252022:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404694.276358:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404694.915297:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728880768:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915382:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404694.915437:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728881280:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404694.915482:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728881792:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404694.915524:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728882304:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404694.915570:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784404694.915575:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728881152:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915599:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404694.915617:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728881664:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915637:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404694.915653:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728882176:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915689:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404694.915735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880768 00000100:00100000:3.0:1784404694.915742:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880768 00000100:00100000:3.0:1784404694.915808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784404694.915817:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728880768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.915896:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728880768:12345-0@lo:400:kworker.0 Request processed in 79us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404694.915904:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784404694.915935:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881280 00000100:00100000:3.0:1784404694.915939:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881280 00000100:00100000:3.0:1784404694.915965:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784404694.915971:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728881280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916002:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728881280:12345-0@lo:400:kworker.0 Request processed in 32us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404694.916009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784404694.916027:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881792 00000100:00100000:3.0:1784404694.916030:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881792 00000100:00100000:3.0:1784404694.916057:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882304 00000100:00100000:3.0:1784404694.916060:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882304 00000100:00100000:3.0:1784404694.916070:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881664 00000100:00100000:3.0:1784404694.916073:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881664 00000100:00100000:3.0:1784404694.916083:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882176 00000100:00100000:3.0:1784404694.916085:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882176 00000100:00100000:3.0:1784404694.916098:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784404694.916104:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728881792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916135:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728881792:12345-0@lo:400:kworker.0 Request processed in 31us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404694.916142:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784404694.916161:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784404694.916167:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728882304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916197:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728882304:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404694.916202:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784404694.916213:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784404694.916219:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728881664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916245:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728881664:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404694.916250:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784404694.916260:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784404694.916266:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728882176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916291:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728882176:12345-0@lo:400:kworker.0 Request processed in 25us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404694.916296:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784404694.916318:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881152 00000100:00100000:3.0:1784404694.916321:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881152 00000100:00100000:3.0:1784404694.916347:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784404694.916352:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728881152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728881152:12345-0@lo:400:kworker.0 Request processed in 32us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404694.916391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784404694.916442:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728881152:0@lo:400:kworker.0 00010000:00080000:3.0:1784404694.916455:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442455180 x1871083728881664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404694.916479:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728881664:0@lo:400:kworker.0 00010000:00080000:3.0:1784404694.916491:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242c380 x1871083728882176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404694.916499:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728882176:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916507:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728880768:0@lo:400:kworker.0 00000100:00100000:3.0:1784404694.916516:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728881280:0@lo:400:kworker.0 00010000:00080000:3.0:1784404694.916524:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442456a00 x1871083728881792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404694.916531:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728881792:0@lo:400:kworker.0 00010000:00080000:3.0:1784404694.916540:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242ed80 x1871083728882304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404694.916546:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728882304:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.918333:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728880896:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.918398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404694.918457:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728881408:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.918481:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404694.918515:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728881920:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.918536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404694.918552:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728882432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404694.918572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404694.918596:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1784404694.918602:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728881024:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.918626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404694.918646:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728881536:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.918667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404694.918678:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728882048:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.918697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404694.918706:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404694.918741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784404694.919011:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404694.919018:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404694.919034:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728880896 00000100:00100000:1.0:1784404694.919041:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728880896 00000100:00100000:1.0:1784404694.919079:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881408 00000100:00100000:1.0:1784404694.919082:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881408 00000100:00100000:1.0:1784404694.919105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881920 00000100:00100000:1.0:1784404694.919108:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881920 00000100:00100000:1.0:1784404694.919121:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881536 00000100:00100000:1.0:1784404694.919123:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881536 00000100:00100000:1.0:1784404694.919134:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882048 00000100:00100000:1.0:1784404694.919136:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882048 00000100:00100000:1.0:1784404694.919149:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784404694.919157:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728880896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.919940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728880896:12345-0@lo:400:kworker.0 Request processed in 55us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404694.919962:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784404694.919988:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784404694.919996:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728881408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.920042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728881408:12345-0@lo:400:kworker.0 Request processed in 48us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404694.920048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784404694.920061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784404694.920067:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728881920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.920097:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728881920:12345-0@lo:400:kworker.0 Request processed in 30us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404694.920102:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784404694.920113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784404694.920119:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728881536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.920146:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728881536:12345-0@lo:400:kworker.0 Request processed in 27us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404694.920152:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784404694.920162:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784404694.920168:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728882048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.920192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728882048:12345-0@lo:400:kworker.0 Request processed in 25us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404694.920198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784404694.921742:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882432 00000100:00100000:1.0:1784404694.921754:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882432 00000100:00100000:1.0:1784404694.922987:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882560 00000100:00100000:1.0:1784404694.922994:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882560 00000100:00100000:1.0:1784404694.923030:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784404694.923038:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728882432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404694.923072:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404694.923145:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728882432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404694.923153:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784404694.923170:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784404694.923176:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728882560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784404694.923191:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404694.924010:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404694.928725:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728881024 00000100:00100000:0.0:1784404694.928740:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728881024 00000100:00100000:0.0:1784404694.928822:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784404694.928834:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728881024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404694.935637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404694.935696:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404694.935719:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728882816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404694.935764:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404694.935822:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882688 00000100:00100000:2.0:1784404694.935831:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882688 00000100:00100000:2.0:1784404694.935887:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882816 00000100:00100000:2.0:1784404694.935902:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882816 00000100:00100000:2.0:1784404694.935921:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404694.935929:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728882688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404694.935952:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404694.935997:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728882688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404694.936005:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404694.936022:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404694.936028:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728882816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404694.936038:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404694.936065:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728882816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404694.936071:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1784404694.936109:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242ed80 x1871083728882816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404694.936128:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728882816:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1784404694.936140:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1dc00 x1871083728882688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404694.936149:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404694.941591:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728882560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 18407us (22841us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404694.941607:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1784404694.941645:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404694.941650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784404694.941690:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442454380 x1871083728881536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404694.941705:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728881536:0@lo:400:kworker.0 00010000:00080000:1.0:1784404694.941729:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442454e00 x1871083728882048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404694.941737:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728882048:0@lo:400:kworker.0 00010000:00080000:1.0:1784404694.941748:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea2a00 x1871083728882560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404694.941765:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404694.941778:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728880896:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.941803:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728881408:0@lo:400:kworker.0 00000100:00100000:1.0:1784404694.941814:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728881920:0@lo:400:kworker.0 00010000:00080000:1.0:1784404694.941824:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242c000 x1871083728882432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404694.941837:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728882432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404694.942287:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728881024:12345-0@lo:400:kworker.0 Request processed in 13453us (23657us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404694.942297:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784404694.942437:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728881024:0@lo:400:kworker.0 00010000:00010000:1.0:1784404695.299093:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404696.325900:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404696.452000:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728882944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404696.452095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404696.457674:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728882944 00000100:00100000:3.0:1784404696.457692:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728882944 00000100:00100000:3.0:1784404696.457799:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784404696.457811:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728882944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404696.457898:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784404696.457999:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728882944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (5904us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404696.458008:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784404696.458186:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728882944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404697.294524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404697.294567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404697.294600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404697.294628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404697.294649:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404697.294667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404697.294702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404697.294734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841280 00000100:00100000:1.0:1784404697.294744:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841280 00000100:00100000:1.0:1784404697.294801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841536 00000100:00100000:1.0:1784404697.294805:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841536 00000100:00100000:1.0:1784404697.294819:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841152 00000100:00100000:1.0:1784404697.294821:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841152 00000100:00100000:1.0:1784404697.294832:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841408 00000100:00100000:1.0:1784404697.294834:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841408 00000100:00100000:1.0:1784404697.294886:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:1.0:1784404697.294895:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707841280:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404697.294969:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707841280:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 75us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404697.294978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:1.0:1784404697.294995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:1.0:1784404697.295002:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841536:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404697.295025:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841536:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404697.295031:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:1.0:1784404697.295042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:1.0:1784404697.295048:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707841152:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404697.295071:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707841152:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404697.295076:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:1.0:1784404697.295087:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:1.0:1784404697.295092:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841408:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404697.295111:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841408:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 19us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404697.295116:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:1.0:1784404697.295134:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841792 00000100:00100000:1.0:1784404697.295137:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841792 00000100:00100000:1.0:1784404697.295163:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841664 00000100:00100000:1.0:1784404697.295166:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841664 00000100:00100000:1.0:1784404697.295197:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:1.0:1784404697.295205:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841792:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404697.295232:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841792:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404697.295238:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:1.0:1784404697.295249:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:1.0:1784404697.295256:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841664:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404697.295277:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707841664:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404697.295283:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00080000:1.0:1784404697.295308:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404697.295312:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404697.295315:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404697.295317:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404697.296111:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841024 00000100:00100000:0.0:1784404697.296118:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841024 00000100:00100000:0.0:1784404697.296169:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 302 00000100:00100000:0.0:1784404697.296176:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707841024:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404697.296222:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707841024:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 46us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404697.296229:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 302 00010000:00010000:2.0:1784404697.348187:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404697.475913:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404697.475939:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728883072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404697.476032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404697.476113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883072 00000100:00100000:3.0:1784404697.476121:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883072 00000100:00100000:3.0:1784404697.476167:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784404697.476175:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd545b84c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728883072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404697.476209:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404697.476256:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd545b84c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728883072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404697.476263:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784404697.476522:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728883072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784404698.371508:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404699.396161:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404700.035071:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728883328:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.035072:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728883456:0@lo:400:kworker.0 00000100:00100000:2.0:1784404700.035981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728883200:0@lo:400:kworker.0 00000100:00100000:1.0:1784404700.044687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728883584:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.045547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.045641:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.045704:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728883840:0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.045731:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.045756:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728884352:0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.045778:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.045812:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728884864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404700.045836:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.046109:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884864 00000100:00100000:0.0:1784404700.046118:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884864 00000100:00100000:0.0:1784404700.046172:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784404700.046182:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728884864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404700.046219:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404700.046271:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728884864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404700.046279:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1784404700.046334:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b3800 x1871083728884864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404700.046399:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883456 00000100:00100000:3.0:1784404700.046404:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883456 00000100:00100000:3.0:1784404700.046434:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784404700.046441:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728883456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.046481:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728883456:12345-0@lo:400:kworker.0 Request processed in 41us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404700.046481:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728884864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404700.046487:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784404700.046544:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883328 00000100:00100000:0.0:1784404700.046549:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883328 00000100:00100000:0.0:1784404700.046573:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883840 00000100:00100000:0.0:1784404700.046576:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883840 00000100:00100000:0.0:1784404700.046590:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884352 00000100:00100000:0.0:1784404700.046592:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884352 00000100:00100000:0.0:1784404700.046606:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784404700.046611:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728883328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.046650:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728883328:12345-0@lo:400:kworker.0 Request processed in 38us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404700.046656:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784404700.046680:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784404700.046686:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728883840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.046715:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728883840:12345-0@lo:400:kworker.0 Request processed in 29us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404700.046720:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784404700.046732:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784404700.046737:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728884352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.046763:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728884352:12345-0@lo:400:kworker.0 Request processed in 26us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404700.046769:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784404700.046799:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728883328:0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.046809:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728883840:0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.046816:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728884352:0@lo:400:kworker.0 00000100:00080000:0.0:1784404700.046882:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404700.046893:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404700.049149:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728883456:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.049165:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728883968:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.049228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404700.049273:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883968 00000100:00100000:3.0:1784404700.049279:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883968 00000100:00100000:3.0:1784404700.049334:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784404700.049343:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728883968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.049404:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728883968:12345-0@lo:400:kworker.0 Request processed in 63us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404700.049411:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1784404700.049434:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784404700.049456:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242c000 x1871083728883968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404700.049466:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728883968:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.049474:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728884480:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.049496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404700.049517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884480 00000100:00100000:3.0:1784404700.049521:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884480 00000100:00100000:3.0:1784404700.049550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784404700.049556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728884480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.050542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728884480:12345-0@lo:400:kworker.0 Request processed in 982us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404700.050552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1784404700.050674:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784404700.050717:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6dc00 x1871083728884480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404700.050730:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728884480:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.050759:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728884992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404700.050789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404700.050826:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404700.050833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728885120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404700.050866:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404700.050895:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884992 00000100:00100000:3.0:1784404700.050900:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884992 00000100:00100000:3.0:1784404700.050930:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728885120 00000100:00100000:3.0:1784404700.050933:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728885120 00000100:00100000:3.0:1784404700.050946:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784404700.050953:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728884992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404700.050972:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404700.051003:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728884992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404700.051009:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784404700.051020:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784404700.051025:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728885120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404700.051040:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404700.051062:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728885120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404700.051067:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1784404700.051079:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404700.051081:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404700.051097:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6f480 x1871083728885120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404700.051110:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728885120:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784404700.051120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6d500 x1871083728884992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404700.051130:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728884992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404700.052493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404700.052552:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728883712:0@lo:400:kworker.0 00000100:00100000:2.0:1784404700.052595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404700.052621:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728884224:0@lo:400:kworker.0 00000100:00100000:2.0:1784404700.052642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404700.052662:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728884736:0@lo:400:kworker.0 00000100:00100000:2.0:1784404700.052696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404700.052780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883712 00000100:00100000:2.0:1784404700.052786:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883712 00000100:00100000:3.0:1784404700.052797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883200 00000100:00100000:3.0:1784404700.052801:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883200 00000100:00100000:2.0:1784404700.052823:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784404700.052829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1784404700.052829:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728883712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.052834:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728883200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.052884:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728883200:12345-0@lo:400:kworker.0 Request processed in 49us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404700.052885:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728883712:12345-0@lo:400:kworker.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404700.052893:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1784404700.052893:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784404700.052917:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404700.052940:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404700.052973:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728883200:0@lo:400:kworker.0 00000100:00100000:2.0:1784404700.052983:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728883712:0@lo:400:kworker.0 00000100:00100000:3.0:1784404700.053687:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728885248 00000100:00100000:3.0:1784404700.053695:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728885248 00000100:00100000:3.0:1784404700.053765:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784404700.053773:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728885248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784404700.053794:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404700.053846:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728885248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404700.053887:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1784404700.054621:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784404700.054683:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362f480 x1871083728885248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404700.054707:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404700.058068:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884224 00000100:00100000:1.0:1784404700.058081:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884224 00000100:00100000:1.0:1784404700.058140:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884736 00000100:00100000:1.0:1784404700.058144:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884736 00000100:00100000:1.0:1784404700.058224:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784404700.058235:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728884224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404700.058350:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728884224:12345-0@lo:400:kworker.0 Request processed in 116us (5705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404700.058370:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784404700.058389:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784404700.058405:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728884736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404700.058437:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728884736:12345-0@lo:400:kworker.0 Request processed in 33us (5740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404700.058443:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1784404700.063730:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6ce00 x1871083728884224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404700.063748:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728884224:0@lo:400:kworker.0 00010000:00080000:1.0:1784404700.063762:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6d880 x1871083728884736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404700.063769:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728884736:0@lo:400:kworker.0 00000100:00100000:1.0:1784404700.063893:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.064199:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728884096:0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.064236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.064262:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884096 00000100:00100000:0.0:1784404700.064268:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884096 00000100:00100000:0.0:1784404700.064310:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784404700.064643:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728884096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.064707:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728884096:12345-0@lo:400:kworker.0 Request processed in 68us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404700.064715:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1784404700.064753:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242ed80 x1871083728884096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404700.064764:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728884096:0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.064771:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728884608:0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.064795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404700.064841:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728884608 00000100:00100000:0.0:1784404700.064846:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728884608 00000100:00100000:0.0:1784404700.064887:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404700.064894:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728884608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404700.064930:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728884608:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404700.064935:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1784404700.066542:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6e300 x1871083728884608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404700.066559:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728884608:0@lo:400:kworker.0 00000100:00100000:1.0:1784404700.067814:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728883584 00000100:00100000:1.0:1784404700.067826:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728883584 00000100:00100000:1.0:1784404700.067898:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784404700.067908:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728883584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404700.068002:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728883584:12345-0@lo:400:kworker.0 Request processed in 95us (4108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404700.068009:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784404700.068499:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728883584:0@lo:400:kworker.0 00000020:00000004:1.0:1784404700.174335:0:12501:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404700.174530:0:12501:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784404700.420451:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404701.443047:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404701.571041:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404701.571066:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728885376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404701.571136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404701.571205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728885376 00000100:00100000:1.0:1784404701.571212:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728885376 00000100:00100000:1.0:1784404701.571271:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784404701.571280:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728885376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404701.571314:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784404701.571362:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728885376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404701.571369:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784404701.571414:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728885376:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1784404702.367118:0:12598:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404702.367370:0:12598:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784404702.419078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404702.419127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404702.419155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404702.419180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404702.419198:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404702.419218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404702.419240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404702.419271:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842176 00000100:00100000:1.0:1784404702.419280:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842176 00000100:00100000:1.0:1784404702.419336:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842432 00000100:00100000:1.0:1784404702.419340:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842432 00000100:00100000:1.0:1784404702.419353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842048 00000100:00100000:1.0:1784404702.419356:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842048 00000100:00100000:1.0:1784404702.419369:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842304 00000100:00100000:1.0:1784404702.419371:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842304 00000100:00100000:1.0:1784404702.419388:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:1.0:1784404702.419399:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707842176:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404702.419475:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707842176:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 78us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404702.419484:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:1.0:1784404702.419502:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:1.0:1784404702.419521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842432:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404702.419548:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842432:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404702.419555:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:1.0:1784404702.419568:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:1.0:1784404702.419574:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707842048:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404702.419598:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707842048:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404702.419604:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:1.0:1784404702.419616:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00100000:1.0:1784404702.419622:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842304:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404702.419655:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842304:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404702.419661:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00080000:1.0:1784404702.419683:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404702.419688:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404702.419895:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707841920 00000100:00100000:0.0:1784404702.419899:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707841920 00000100:00100000:0.0:1784404702.419940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 304 00000100:00100000:0.0:1784404702.419948:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707841920:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404702.419984:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707841920:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 37us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404702.419991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 304 00000100:00100000:0.0:1784404702.420021:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842688 00000100:00100000:0.0:1784404702.420025:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842688 00000100:00100000:0.0:1784404702.420052:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842560 00000100:00100000:0.0:1784404702.420055:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842560 00000100:00100000:0.0:1784404702.420075:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1784404702.420082:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842688:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404702.420109:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842688:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404702.420115:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1784404702.420126:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:0.0:1784404702.420132:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842560:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404702.420158:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707842560:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404702.420164:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00080000:0.0:1784404702.420226:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404702.420231:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784404702.492323:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404702.595540:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728885504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404702.595616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404702.595707:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728885504 00000100:00100000:3.0:1784404702.595716:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728885504 00000100:00100000:3.0:1784404702.595766:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784404702.595775:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728885504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404702.595810:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404702.595878:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728885504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404702.595886:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784404702.595932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728885504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784404703.492054:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784404704.494601:0:12696:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404704.495496:0:12696:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404704.518038:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404705.156248:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728885760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404705.156326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404705.156384:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728885632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404705.156421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404705.156460:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728885760 00000100:00100000:0.0:1784404705.156467:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728885760 00000100:00100000:0.0:1784404705.156511:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728885632 00000100:00100000:0.0:1784404705.156514:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728885632 00000100:00100000:0.0:1784404705.156545:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784404705.156553:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728885760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784404705.156582:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404705.156635:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728885760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.156642:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784404705.156819:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784404705.156826:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728885632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784404705.156841:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404705.156899:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728885632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.156905:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1784404705.156926:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404705.156930:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404705.156967:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728885888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404705.156991:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784404705.157043:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6d500 x1871083728885760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404705.157061:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728885760:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1784404705.157073:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242c700 x1871083728885632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404705.157090:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728885632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404705.157114:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728885888 00000100:00100000:0.0:1784404705.157118:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728885888 00000100:00100000:0.0:1784404705.157143:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784404705.157149:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728885888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404705.157157:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404705.157187:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728885888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.157193:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1784404705.157208:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784404705.157224:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242ca80 x1871083728885888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404705.157236:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728885888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404705.165286:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784404705.165310:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728886528:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.165351:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728886272:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.165383:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728886400:0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404705.165408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404705.165433:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728886912:0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165440:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728886144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404705.165454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404705.165459:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404705.165472:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728886016:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.165482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404705.165498:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728886784:0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404705.165517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404705.165533:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728887296:0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165533:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728887040:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.165552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404705.165552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404705.165563:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784404705.165568:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728886656:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.165578:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886400 00000100:00100000:2.0:1784404705.165584:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886400 00000100:00100000:0.0:1784404705.165603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404705.165631:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728887168:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.165633:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886656 00000100:00100000:2.0:1784404705.165636:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886656 00000100:00100000:2.0:1784404705.165654:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784404705.165654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404705.165664:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728886400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886528 00000100:00100000:0.0:1784404705.165692:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886528 00000100:00100000:0.0:1784404705.165712:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886912 00000100:00100000:0.0:1784404705.165714:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886912 00000100:00100000:2.0:1784404705.165723:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728886400:12345-0@lo:400:kworker.0 Request processed in 60us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404705.165730:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784404705.165734:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886272 00000100:00100000:0.0:1784404705.165736:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886272 00000100:00100000:0.0:1784404705.165744:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886784 00000100:00100000:0.0:1784404705.165746:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886784 00000100:00100000:2.0:1784404705.165747:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784404705.165752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165757:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887040 00000100:00100000:0.0:1784404705.165759:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887040 00000100:00100000:0.0:1784404705.165769:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887168 00000100:00100000:0.0:1784404705.165771:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887168 00000100:00100000:2.0:1784404705.165782:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728886656:12345-0@lo:400:kworker.0 Request processed in 30us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.165784:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784404705.165788:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784404705.165789:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728886528:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.165825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784404705.165828:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784404705.165835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728886912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784404705.165841:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728886272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.165884:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728886912:12345-0@lo:400:kworker.0 Request processed in 49us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404705.165891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784404705.165891:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728886272:12345-0@lo:400:kworker.0 Request processed in 50us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.165896:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784404705.165904:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784404705.165910:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728886784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.165973:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784404705.165981:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728887040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.166011:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728887040:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.166023:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784404705.166036:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784404705.166041:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728887168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.166070:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728887168:12345-0@lo:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.166075:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784404705.166093:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886016 00000100:00100000:0.0:1784404705.166097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886016 00000100:00100000:0.0:1784404705.166135:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784404705.166142:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728886016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404705.166170:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728886016:12345-0@lo:400:kworker.0 Request processed in 29us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.166176:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:0.0:1784404705.166204:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404705.166208:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404705.166217:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728886144 00000100:00100000:0.0:1784404705.166220:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728886144 00000100:00100000:0.0:1784404705.166246:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784404705.166251:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728886144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404705.166265:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404705.166295:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728886144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404705.166300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1784404705.166317:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404705.166412:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728886784:12345-0@lo:400:kworker.0 Request processed in 501us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404705.166419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784404705.166443:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887296 00000100:00100000:2.0:1784404705.166446:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887296 00000100:00100000:2.0:1784404705.166476:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404705.166483:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728887296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.166513:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728887296:12345-0@lo:400:kworker.0 Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404705.166519:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404705.166553:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728886272:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.166564:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728886784:0@lo:400:kworker.0 00010000:00080000:2.0:1784404705.166576:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574f1ce00 x1871083728887296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404705.166586:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728887296:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.166616:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728886400:0@lo:400:kworker.0 00010000:00080000:2.0:1784404705.166638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362f800 x1871083728886912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404705.166652:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728886912:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.166680:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728886656:0@lo:400:kworker.0 00010000:00080000:2.0:1784404705.166690:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362f100 x1871083728887168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404705.166698:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728887168:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.166706:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728887040:0@lo:400:kworker.0 00000100:00100000:2.0:1784404705.166715:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728886528:0@lo:400:kworker.0 00010000:00080000:2.0:1784404705.166722:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242ca80 x1871083728886144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404705.166732:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728886144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404705.166740:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728886016:0@lo:400:kworker.0 00010000:00010000:2.0:1784404705.539898:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404706.563979:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784404706.594642:0:12793:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404706.595197:0:12793:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784404706.692094:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404706.692118:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728887424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404706.692449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404706.693063:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887424 00000100:00100000:2.0:1784404706.693072:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887424 00000100:00100000:2.0:1784404706.693137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784404706.693147:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728887424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404706.693182:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404706.693253:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728887424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404706.693269:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784404706.693464:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728887424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404707.537701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404707.537758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404707.537790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404707.537815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404707.537835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404707.537894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404707.537932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404707.537962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843072 00000100:00100000:1.0:1784404707.537972:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843072 00000100:00100000:1.0:1784404707.538040:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843328 00000100:00100000:1.0:1784404707.538044:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843328 00000100:00100000:1.0:1784404707.538058:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842944 00000100:00100000:1.0:1784404707.538061:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842944 00000100:00100000:1.0:1784404707.538070:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843200 00000100:00100000:1.0:1784404707.538072:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843200 00000100:00100000:1.0:1784404707.538088:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:1.0:1784404707.538096:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707843072:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404707.538169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707843072:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 74us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404707.538176:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:1.0:1784404707.538192:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 155 00000100:00100000:1.0:1784404707.538198:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707843328:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404707.538221:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707843328:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404707.538227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 155 00000100:00100000:1.0:1784404707.538238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 156 00000100:00100000:1.0:1784404707.538243:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707842944:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404707.538264:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707842944:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 21us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404707.538270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 156 00000100:00100000:1.0:1784404707.538280:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 157 00000100:00100000:1.0:1784404707.538293:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707843200:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404707.538316:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707843200:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404707.538321:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 157 00000100:00100000:1.0:1784404707.538344:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843456 00000100:00100000:1.0:1784404707.538347:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843456 00000100:00100000:1.0:1784404707.538372:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843584 00000100:00100000:1.0:1784404707.538375:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843584 00000100:00100000:1.0:1784404707.538393:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1784404707.538399:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2400:x1871083707843456:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:1.0:1784404707.538417:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78e76 00000100:00080000:1.0:1784404707.538425:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9dd577f5d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784404707.538465:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1784404707.538582:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+2:2400:x1871083707843456:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 182us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404707.538589:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1784404707.538612:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1784404707.538619:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2400:x1871083707843584:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:1.0:1784404707.538632:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78e7d 00000100:00080000:1.0:1784404707.538637:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9dd443682800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784404707.538670:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1784404707.538740:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+2:2400:x1871083707843584:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 121us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404707.538747:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00080000:1.0:1784404707.538769:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404707.538773:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404707.538782:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404707.538784:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784404707.538872:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404707.538962:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404707.539205:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707842816 00000100:00100000:3.0:1784404707.539217:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707842816 00000100:00100000:3.0:1784404707.539267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 306 00000100:00100000:3.0:1784404707.539275:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707842816:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404707.539314:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707842816:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 40us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404707.539327:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 306 00010000:00010000:0.0:1784404707.594813:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404707.719147:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728887552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404707.719218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404707.719322:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887552 00000100:00100000:3.0:1784404707.719330:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887552 00000100:00100000:3.0:1784404707.719387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784404707.719397:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728887552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404707.719432:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404707.719784:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728887552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 387us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404707.719792:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784404707.719971:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728887552:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1784404708.543259:0:12890:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404708.543789:0:12890:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784404708.611080:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404709.637609:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404710.275236:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404710.275283:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728887808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404710.275381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404710.275457:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887808 00000100:00100000:0.0:1784404710.275466:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887808 00000100:00100000:0.0:1784404710.275520:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784404710.275529:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728887808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404710.275559:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404710.275618:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728887808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404710.275626:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1784404710.275675:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242ca80 x1871083728887808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404710.275696:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728887808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404710.275918:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728887680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404710.275953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.276019:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887680 00000100:00100000:2.0:1784404710.276023:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887680 00000100:00100000:2.0:1784404710.276051:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784404710.276058:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728887680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404710.276068:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404710.276099:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728887680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.276106:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1784404710.276131:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6d500 x1871083728887680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404710.276143:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728887680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404710.276162:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404710.276185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.276213:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728887936 00000100:00100000:2.0:1784404710.276216:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728887936 00000100:00100000:2.0:1784404710.276238:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784404710.276245:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728887936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404710.276277:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404710.276314:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728887936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.276320:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1784404710.276358:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44362d880 x1871083728887936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404710.276370:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404710.276727:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728888320:0@lo:400:kworker.0 00000100:00100000:3.0:1784404710.276764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404710.276794:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728888832:0@lo:400:kworker.0 00000100:00100000:3.0:1784404710.276821:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404710.276845:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784404710.276879:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728888448:0@lo:400:kworker.0 00000100:00100000:3.0:1784404710.276900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404710.276917:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728888960:0@lo:400:kworker.0 00000100:00100000:3.0:1784404710.276935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404710.277207:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888320 00000100:00100000:0.0:1784404710.277212:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888320 00000100:00100000:0.0:1784404710.277259:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784404710.277268:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404710.277334:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728888320:12345-0@lo:400:kworker.0 Request processed in 67us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404710.277563:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784404710.277614:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728888320:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.277838:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728888064:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.277903:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.277925:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728888576:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.277947:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.277966:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728889088:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.277988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.278007:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784404710.278015:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728888192:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.278048:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728888704:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278067:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.278079:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728889216:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404710.278129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888832 00000100:00100000:2.0:1784404710.278133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888832 00000100:00100000:2.0:1784404710.278165:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888448 00000100:00100000:2.0:1784404710.278168:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888448 00000100:00100000:2.0:1784404710.278181:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888960 00000100:00100000:2.0:1784404710.278196:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888960 00000100:00100000:2.0:1784404710.278228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889088 00000100:00100000:2.0:1784404710.278232:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889088 00000100:00100000:2.0:1784404710.278245:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888192 00000100:00100000:2.0:1784404710.278247:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888192 00000100:00100000:2.0:1784404710.278258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888704 00000100:00100000:2.0:1784404710.278271:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888704 00000100:00100000:2.0:1784404710.278290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784404710.278297:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728888832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728888832:12345-0@lo:400:kworker.0 Request processed in 67us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278371:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784404710.278385:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784404710.278392:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728888448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278420:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728888448:12345-0@lo:400:kworker.0 Request processed in 29us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278426:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784404710.278438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784404710.278444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728888960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278473:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728888960:12345-0@lo:400:kworker.0 Request processed in 29us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784404710.278490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784404710.278495:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728889088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278526:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728889088:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784404710.278553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784404710.278559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728888192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278602:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728888192:12345-0@lo:400:kworker.0 Request processed in 44us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278609:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784404710.278621:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784404710.278627:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728888704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278654:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728888704:12345-0@lo:400:kworker.0 Request processed in 27us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278659:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784404710.278680:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889216 00000100:00100000:2.0:1784404710.278683:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889216 00000100:00100000:2.0:1784404710.278720:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404710.278728:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728889216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278759:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728889216:12345-0@lo:400:kworker.0 Request processed in 33us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278764:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404710.278788:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888576 00000100:00100000:2.0:1784404710.278791:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888576 00000100:00100000:2.0:1784404710.278807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784404710.278812:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728888576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278842:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728888576:12345-0@lo:400:kworker.0 Request processed in 29us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404710.278848:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784404710.278913:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728888448:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278924:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728888960:0@lo:400:kworker.0 00010000:00080000:2.0:1784404710.278946:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f90a80 x1871083728888832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404710.278956:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728888832:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278987:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728888192:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.278995:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728888704:0@lo:400:kworker.0 00010000:00080000:2.0:1784404710.279004:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442557100 x1871083728889216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404710.279012:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728889216:0@lo:400:kworker.0 00000100:00100000:2.0:1784404710.279021:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728888576:0@lo:400:kworker.0 00010000:00080000:2.0:1784404710.279030:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f91500 x1871083728889088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404710.279038:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728889088:0@lo:400:kworker.0 00000100:00100000:0.0:1784404710.279993:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728888064 00000100:00100000:0.0:1784404710.280001:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728888064 00000100:00100000:0.0:1784404710.280044:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784404710.280054:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728888064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404710.280132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728888064:12345-0@lo:400:kworker.0 Request processed in 79us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404710.280139:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784404710.280190:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728888064:0@lo:400:kworker.0 00000100:00080000:1.0:1784404710.282526:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404710.282537:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404710.282540:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404710.282543:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404710.282892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404710.282912:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728889344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404710.282977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404710.283989:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889344 00000100:00100000:3.0:1784404710.283999:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889344 00000100:00100000:3.0:1784404710.284049:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784404710.284066:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728889344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404710.284091:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404710.284150:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728889344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404710.284157:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1784404710.284196:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083728889344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404710.284215:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728889344:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784404710.659025:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404711.683616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404711.812447:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404711.812483:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728889472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404711.812568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404711.812832:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889472 00000100:00100000:1.0:1784404711.812839:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889472 00000100:00100000:1.0:1784404711.812922:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784404711.812932:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728889472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404711.812968:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784404711.813016:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728889472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404711.813023:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784404711.813115:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728889472:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1784404712.500936:0:13035:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1784404712.667763:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404712.667862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404712.667883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404712.667902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404712.667922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404712.667947:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843968 00000100:00100000:2.0:1784404712.667956:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843968 00000100:00100000:2.0:1784404712.668000:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844224 00000100:00100000:2.0:1784404712.668003:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844224 00000100:00100000:2.0:1784404712.668015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843840 00000100:00100000:2.0:1784404712.668017:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843840 00000100:00100000:2.0:1784404712.668038:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844096 00000100:00100000:2.0:1784404712.668041:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844096 00000100:00100000:2.0:1784404712.668056:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:2.0:1784404712.668065:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707843968:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404712.668140:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707843968:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404712.668148:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:2.0:1784404712.668166:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:2.0:1784404712.668173:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707844224:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404712.668196:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707844224:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404712.668201:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:2.0:1784404712.668213:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:2.0:1784404712.668219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707843840:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404712.668242:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707843840:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404712.668248:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:2.0:1784404712.668259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00100000:2.0:1784404712.668265:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707844096:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404712.668288:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707844096:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404712.668294:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00080000:2.0:1784404712.668316:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404712.668321:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404712.674139:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707843712 00000100:00100000:3.0:1784404712.674156:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707843712 00000100:00100000:3.0:1784404712.674222:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 308 00000100:00100000:3.0:1784404712.674233:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707843712:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404712.675651:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707843712:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 1409us (7888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404712.675663:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 308 00010000:00010000:0.0:1784404712.711801:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404712.835769:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728889600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404712.835881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404712.836042:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889600 00000100:00100000:1.0:1784404712.836051:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889600 00000100:00100000:1.0:1784404712.836106:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784404712.836117:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728889600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404712.836154:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784404712.836204:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728889600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404712.836212:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784404712.836384:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728889600:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1784404712.837176:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00000020:00000080:1.0:1784404712.837192:0:9511:0:(genops.c:885:class_export_put()) final put ffff9dd443680000/699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00100000:0.0:1784404712.838713:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00000020:00000080:0.0:1784404712.838722:0:8427:0:(genops.c:885:class_export_put()) final put ffff9dd574f22800/699a5e6e-e921-4091-819a-62d5132b8ddf 00000020:00000080:3.0:1784404712.843038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443680000/699a5e6e-e921-4091-819a-62d5132b8ddf for lustre-OST0001 00000020:00000080:3.0:1784404712.843656:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443682800 for lustre-OST0001 00000020:00000080:3.0:1784404712.844382:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574f22800/699a5e6e-e921-4091-819a-62d5132b8ddf for lustre-OST0000 00000020:00000080:3.0:1784404712.844419:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd577f5d000 for lustre-OST0000 00010000:00010000:0.0:1784404713.731877:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404714.755158:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404715.395277:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404715.395301:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728889728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404715.395381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.395451:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728890112:0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395470:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728889984:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.395484:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404715.395510:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.395524:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728890624:0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395543:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728890496:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.395574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.395604:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728891136:0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395609:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889984 00000100:00100000:3.0:1784404715.395618:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889984 00000100:00100000:0.0:1784404715.395629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.395652:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784404715.395658:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728890240:0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395664:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728890624 00000100:00100000:3.0:1784404715.395675:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728890624 00000100:00100000:0.0:1784404715.395682:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.395695:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728890752:0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395702:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728891136 00000100:00100000:3.0:1784404715.395706:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728891136 00000100:00100000:0.0:1784404715.395719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404715.395724:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728890240 00000100:00100000:3.0:1784404715.395727:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728890240 00000100:00100000:0.0:1784404715.395740:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728891264:0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395746:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784404715.395756:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728889984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.395765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.395794:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728889856:0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395807:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728889984:12345-0@lo:400:kworker.0 Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404715.395815:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784404715.395830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404715.395834:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784404715.395842:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728890624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395894:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728890624:12345-0@lo:400:kworker.0 Request processed in 53us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404715.395900:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784404715.395911:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784404715.395916:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728891136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.395947:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728891136:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404715.395954:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784404715.395966:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784404715.395972:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728890240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404715.396002:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728890240:12345-0@lo:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404715.396008:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784404715.396016:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728890112 00000100:00100000:1.0:1784404715.396027:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728890112 00000100:00100000:1.0:1784404715.396068:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784404715.396076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728890112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404715.396112:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728890112:12345-0@lo:400:kworker.0 Request processed in 37us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.396118:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784404715.396142:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728890752 00000100:00100000:1.0:1784404715.396145:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728890752 00000100:00100000:1.0:1784404715.396166:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728891264 00000100:00100000:1.0:1784404715.396169:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728891264 00000100:00100000:1.0:1784404715.396186:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784404715.396192:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728890752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404715.396223:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728890752:12345-0@lo:400:kworker.0 Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.396229:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784404715.396240:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784404715.396247:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728891264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404715.396275:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728891264:12345-0@lo:400:kworker.0 Request processed in 30us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.396280:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784404715.397048:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889728 00000100:00100000:2.0:1784404715.397056:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889728 00000100:00100000:2.0:1784404715.397095:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784404715.397103:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728889728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404715.397128:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404715.397174:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728889728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404715.397181:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1784404715.397212:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404715.397216:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404715.397219:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404715.397230:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728889856 00000100:00100000:2.0:1784404715.397234:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728889856 00000100:00100000:2.0:1784404715.397259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784404715.397265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728889856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404715.397298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728889856:12345-0@lo:400:kworker.0 Request processed in 33us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404715.397307:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784404715.397557:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404715.397570:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728891648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404715.397604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404715.397635:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728891648 00000100:00100000:1.0:1784404715.397639:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728891648 00000100:00100000:1.0:1784404715.397664:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784404715.397671:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728891648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404715.397698:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404715.397734:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728891648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.397740:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1784404715.400099:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083728891648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404715.400129:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728891648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404715.400266:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728889856:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.400278:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728890368:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.400364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.400397:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728890880:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.400418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.400446:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728891392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404715.400464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.400493:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404715.400500:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728891520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404715.400517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.400573:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728891392 00000100:00100000:0.0:1784404715.400586:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728891392 00000100:00100000:0.0:1784404715.400631:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728891520 00000100:00100000:0.0:1784404715.400634:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728891520 00000100:00100000:0.0:1784404715.400647:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784404715.400655:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728891392:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404715.400718:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728890368 00000100:00100000:1.0:1784404715.400721:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728890368 00000100:00100000:1.0:1784404715.400750:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784404715.400756:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728890368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404715.400806:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728890368:12345-0@lo:400:kworker.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.400813:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00002000:00000024:0.0:1784404715.401081:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404715.401115:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728891392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 461us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.401121:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784404715.401134:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784404715.401140:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728891520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404715.401148:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404715.401168:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728891520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.401173:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1784404715.401185:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404715.401201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.401223:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728891008:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.401271:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728889984:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401292:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728890496 00000100:00100000:0.0:1784404715.401295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728890496 00000100:00100000:0.0:1784404715.401321:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728891008 00000100:00100000:0.0:1784404715.401324:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728891008 00000100:00100000:0.0:1784404715.401340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784404715.401345:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728890496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401375:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728890496:12345-0@lo:400:kworker.0 Request processed in 30us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.401388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784404715.401399:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784404715.401403:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728891008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728891008:12345-0@lo:400:kworker.0 Request processed in 23us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.401432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1784404715.401449:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404715.401463:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728890496:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401471:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728891008:0@lo:400:kworker.0 00010000:00080000:0.0:1784404715.401501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443183480 x1871083728891520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401516:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728891520:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784404715.401525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c928000 x1871083728891392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401548:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728891392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404715.401559:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728890368:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401581:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728890880 00000100:00100000:0.0:1784404715.401584:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728890880 00000100:00100000:0.0:1784404715.401603:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784404715.401609:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728890880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401638:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728890880:12345-0@lo:400:kworker.0 Request processed in 29us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.401643:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1784404715.401669:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348d500 x1871083728890880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401678:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728890880:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401697:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728890240:0@lo:400:kworker.0 00010000:00080000:0.0:1784404715.401708:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348fb80 x1871083728890752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401716:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728890752:0@lo:400:kworker.0 00010000:00080000:0.0:1784404715.401725:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443181c00 x1871083728891264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401732:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728891264:0@lo:400:kworker.0 00000100:00100000:0.0:1784404715.401741:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728890112:0@lo:400:kworker.0 00010000:00080000:0.0:1784404715.401750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348d880 x1871083728890624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401757:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728890624:0@lo:400:kworker.0 00010000:00080000:0.0:1784404715.401766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443182300 x1871083728891136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401773:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728891136:0@lo:400:kworker.0 00010000:00080000:0.0:1784404715.401783:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92b480 x1871083728889728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404715.401793:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728889728:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784404715.780021:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784404715.913423:0:13182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcaca29b90 20000000:00000080:1.0:1784404715.913442:0:13182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd4431aa400 uarg=0000000000000000 20000000:01000000:1.0:1784404715.913484:0:13182:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784404715.913489:0:13182:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784404715.913494:0:13182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784404715.914020:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784404715.914261:0:13182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784404715.922922:0:13182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784404715.923281:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923316:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923326:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923333:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923339:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923345:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923413:0:13182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923424:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923477:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923493:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 12 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.923507:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728891776:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404715.923637:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923652:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 23 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.923661:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728891904:0@lo:104: 00000100:00100000:0.0:1784404715.923714:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404715.923764:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923772:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 23 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.923779:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892032:0@lo:104: 00000100:00100000:0.0:1784404715.923799:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404715.923893:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.923901:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 23 pid: 6511 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.923909:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892160:0@lo:104: 00000100:00100000:0.0:1784404715.923926:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784404715.924988:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.924998:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 23 pid: 6514 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.925009:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892288:0@lo:104: 00000100:00100000:0.0:1784404715.925046:0:13182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404715.925234:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728891904 00000100:00100000:1.0:1784404715.925242:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728891904 00000100:00100000:1.0:1784404715.925280:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728892032 00000100:00100000:1.0:1784404715.925283:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728892032 00000100:00100000:1.0:1784404715.925293:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728892160 00000100:00100000:1.0:1784404715.925296:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728892160 00000100:00100000:1.0:1784404715.925308:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784404715.925322:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:13182:x1871083728891904:12345-0@lo:104: 00010000:00010000:1.0:1784404715.925335:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404715.925545:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784404715.925552:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:13182:x1871083728891904:12345-0@lo:104: Request processed in 231us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.925558:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784404715.925576:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404715.925582:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:13182:x1871083728892032:12345-0@lo:104: 00010000:00010000:1.0:1784404715.925589:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925641:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404715.925649:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925657:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404715.925661:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925669:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404715.925696:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404715.925702:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404715.925732:0:10394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925737:0:10394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404715.925758:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925765:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd78e45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e4c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925778:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404715.925781:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925788:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404715.925791:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925798:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404715.925804:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404715.925810:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404715.925827:0:10394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925832:0:10394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404715.925847:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925869:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443548600/0x24b3e2e6dcd78e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.925878:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404715.925880:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404715.925882:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404715.925903:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728892416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404715.925933:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404715.925973:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728892544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404715.925997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404715.926026:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728892416 00000100:00100000:2.0:1784404715.926029:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728892416 00010000:00010000:2.0:1784404715.926050:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 24 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404715.926071:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728892544 00000100:00100000:2.0:1784404715.926074:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728892544 00010000:00010000:2.0:1784404715.926084:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 25 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404715.926100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784404715.926107:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+25:3649:x1871083728892416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404715.926116:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404715.926127:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 25 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.926136:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 25 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.926167:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404715.926194:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+25:3649:x1871083728892416:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404715.926200:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784404715.926214:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784404715.926219:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728892544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404715.926226:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404715.926230:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 24 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.926237:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 24 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.926245:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404715.926267:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728892544:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404715.926273:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784404715.926312:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728892544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404715.926333:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728892416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404715.926626:0:13182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.926637:0:13182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 12 pid: 6513 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.926646:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892672:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404715.926698:0:13182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570673a80 going to sleep for 11 seconds 00010000:00010000:0.0:1784404715.926711:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd78e4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e45 expref: 23 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.926722:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728891904:0@lo:104: 00010000:00010000:0.0:1784404715.926731:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd78e3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e37 expref: 22 pid: 6513 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.926739:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892032:0@lo:104: 00010000:00010000:1.0:1784404715.930492:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1784404715.930512:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:13182:x1871083728892032:12345-0@lo:104: Request processed in 4923us (6705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.930534:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404715.930574:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728892288 00000100:00100000:1.0:1784404715.930582:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728892288 00000100:00100000:1.0:1784404715.930617:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784404715.930625:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:13182:x1871083728892160:12345-0@lo:104: 00010000:00010000:1.0:1784404715.930641:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404715.930784:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892160:0@lo:104: 00000100:00100000:2.0:1784404715.932373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404715.932402:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844352 00000100:00100000:2.0:1784404715.932425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844352 00010000:00010000:2.0:1784404715.932463:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 13 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404715.932491:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:2.0:1784404715.932501:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707844352:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404715.932515:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404715.932529:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 13 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.932543:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 13 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.932562:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404715.932607:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707844352:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404715.932615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00010000:00010000:3.0:1784404715.933055:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541391800/0x24b3e2e6dcd78e61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7118 expref: 12 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404715.933074:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728891776:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404715.935484:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404715.935496:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935506:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821db200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404715.935509:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935518:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404715.935535:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404715.935554:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784404715.935610:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935616:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404715.935654:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935662:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821db200/0x24b3e2e6dcd78e29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935676:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404715.935678:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404715.935680:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404715.935689:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404715.935707:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728892800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404715.935782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.935839:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728892800 00000100:00100000:0.0:1784404715.935846:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728892800 00010000:00010000:0.0:1784404715.935896:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 22 pid: 6511 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.935924:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404715.935935:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3646:x1871083728892800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404715.935948:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404715.935953:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 22 pid: 6511 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935963:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 22 pid: 6511 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935984:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd78e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e29 expref: 22 pid: 6511 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.935998:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404715.936034:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3646:x1871083728892800:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.936042:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404715.936080:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728892800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404715.940015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404715.940168:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892672:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404715.940306:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844480 00000100:00100000:0.0:1784404715.940312:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844480 00010000:00010000:0.0:1784404715.940348:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 12 pid: 6513 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.940394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1784404715.940404:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:2403:x1871083707844480:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404715.940417:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404715.940423:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 12 pid: 6513 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.940441:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 12 pid: 6513 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.940459:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d9 expref: 12 pid: 6513 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.940475:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404715.940536:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:2403:x1871083707844480:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 132us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.940557:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00010000:00010000:1.0:1784404715.940994:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1784404715.941004:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:13182:x1871083728892160:12345-0@lo:104: Request processed in 10378us (17074us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.941012:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784404715.941037:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784404715.941045:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:13182:x1871083728892288:12345-0@lo:104: 00010000:00010000:1.0:1784404715.941057:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404715.941114:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784404715.941119:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:13182:x1871083728892288:12345-0@lo:104: Request processed in 76us (16073us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404715.941125:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784404715.941319:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13182:1871083728892288:0@lo:104: 00010000:00010000:3.0:1784404715.941361:0:13182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.941535:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404715.941543:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.941550:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404715.941554:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.941562:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404715.941569:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404715.941583:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404715.941638:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.941644:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404715.941665:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.941671:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151b400/0x24b3e2e6dcd78e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78e22 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404715.941685:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404715.941686:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404715.941688:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404715.941701:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728892928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404715.941739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404715.941978:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728892928 00000100:00100000:0.0:1784404715.941984:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728892928 00010000:00010000:0.0:1784404715.942004:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 21 pid: 6514 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404715.942036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784404715.942043:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3648:x1871083728892928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404715.942054:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404715.942058:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 21 pid: 6514 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942068:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 21 pid: 6514 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942080:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd78e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e1b expref: 21 pid: 6514 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942093:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942101:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942114:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942120:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942136:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942142:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942147:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404715.942161:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942168:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942184:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404715.942193:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404715.942230:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:3648:x1871083728892928:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404715.942237:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784404715.942287:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728892928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404715.942303:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404715.942531:0:13182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404715.942540:0:13182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404715.942546:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd78e84 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404716.804021:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404716.931077:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404716.931102:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728893056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404716.931175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404716.931343:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893056 00000100:00100000:1.0:1784404716.931350:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893056 00000100:00100000:1.0:1784404716.931406:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784404716.931427:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728893056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404716.931459:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784404716.931505:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728893056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404716.931512:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784404716.931836:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728893056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404717.399931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404717.404402:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844608 00000100:00100000:0.0:1784404717.404496:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844608 00000100:00100000:0.0:1784404717.404719:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 310 00000100:00100000:0.0:1784404717.404732:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:6173:x1871083707844608:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404717.404752:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404717.404774:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7149 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404717.404808:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404717.404820:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404717.404830:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151bc00, rc 0) 00000100:00100000:0.0:1784404717.404930:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707844608:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 201us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404717.404939:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 310 00000100:00100000:3.0:1784404717.407813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404717.413708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844736 00000100:00100000:2.0:1784404717.413723:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844736 00000100:00100000:2.0:1784404717.413778:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 311 00000100:00100000:2.0:1784404717.413787:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707844736:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.413969:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707844736:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 182us (6166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404717.413978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 311 00000100:00100000:3.0:1784404717.419001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404717.421451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844864 00000100:00100000:2.0:1784404717.421465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844864 00000100:00100000:2.0:1784404717.421543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 312 00000100:00100000:2.0:1784404717.421563:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707844864:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.421913:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707844864:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 352us (2919us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404717.421921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 312 00000100:00100000:1.0:1784404717.429429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404717.430520:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707844992 00000100:00100000:3.0:1784404717.431398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707844992 00000100:00100000:3.0:1784404717.431474:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 313 00000100:00100000:3.0:1784404717.431488:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707844992:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404717.431506:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404717.431532:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7150 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.431733:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.431758:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.431768:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167e200, rc 0) 00000100:00100000:3.0:1784404717.431832:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707844992:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 349us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404717.431839:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 313 00000100:00100000:3.0:1784404717.435131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404717.435272:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707845120 00000100:00100000:1.0:1784404717.435281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707845120 00000100:00100000:1.0:1784404717.435437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 314 00000100:00100000:1.0:1784404717.435448:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707845120:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404717.435633:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707845120:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 187us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404717.435642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 314 00000100:00100000:1.0:1784404717.440821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404717.442755:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707845248 00000100:00100000:2.0:1784404717.442769:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707845248 00000100:00100000:2.0:1784404717.442824:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 315 00000100:00100000:2.0:1784404717.442834:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707845248:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.442978:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707845248:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 144us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404717.442986:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 315 10000000:01000000:3.0:1784404717.448979:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784404717.448987:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442280800 from 7 10000000:01000000:3.0:1784404717.448993:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784404717.449037:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.449048:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.449059:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404717.449095:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404717.449171:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404717.449229:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510afa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404717.449676:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893184 00000100:00100000:1.0:1784404717.449692:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893184 00000100:00100000:1.0:1784404717.449749:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1784404717.449759:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728893184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404717.449786:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404717.449802:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78e99 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404717.449827:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404717.449873:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404717.449884:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548200, rc 0) 00000100:00100000:1.0:1784404717.449933:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728893184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404717.449940:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784404717.450634:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404717.450652:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.450675:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404717.450743:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404717.450775:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404717.450810:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510afa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404717.450826:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893312 00000100:00100000:3.0:1784404717.450830:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893312 00000100:00100000:3.0:1784404717.451113:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784404717.451121:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728893312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404717.451301:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728893312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404717.451376:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784404717.451472:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404717.451505:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404717.451658:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404717.451686:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265540 going to sleep for 11 seconds 00000100:00100000:2.0:1784404717.451951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893440 00000100:00100000:2.0:1784404717.451956:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893440 00000100:00100000:2.0:1784404717.451990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1784404717.451998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728893440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.452077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728893440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404717.452084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1784404717.452292:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784404717.456042:0:13236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784404717.461457:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784404717.461506:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404717.461527:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.461547:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404717.461568:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784404717.461571:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd574d3a800 from 7 10000000:01000000:2.0:1784404717.461574:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784404717.461611:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.461619:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.461630:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404717.461656:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.461727:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.461779:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c900 going to sleep for 11 seconds 00000100:00100000:3.0:1784404717.461927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893568 00000100:00100000:3.0:1784404717.461934:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893568 00000100:00100000:3.0:1784404717.461979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784404717.461989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728893568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404717.462002:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404717.462020:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ea7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.462043:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.462052:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.462060:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167fc00, rc 0) 00000100:00100000:3.0:1784404717.462099:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728893568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404717.462106:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1784404717.462244:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404717.462259:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.462267:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404717.462444:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.462472:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.462498:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c900 going to sleep for 11 seconds 00000100:00100000:1.0:1784404717.462559:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893696 00000100:00100000:1.0:1784404717.462564:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893696 00000100:00100000:1.0:1784404717.462594:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1784404717.462601:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728893696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404717.462703:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728893696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404717.462709:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784404717.462839:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.462890:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.462931:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.462945:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c900 going to sleep for 11 seconds 00000100:00100000:1.0:1784404717.463020:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893824 00000100:00100000:1.0:1784404717.463024:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893824 00000100:00100000:1.0:1784404717.463081:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784404717.463088:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728893824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404717.463174:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728893824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404717.463181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784404717.463247:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784404717.463941:0:13239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784404717.463995:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784404717.464012:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404717.464022:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.464032:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404717.464043:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784404717.464045:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd565e88000 from 7 10000000:01000000:2.0:1784404717.464048:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784404717.464073:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.464081:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.464089:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404717.464104:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.464143:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.468002:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404717.468291:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728893952 00000100:00100000:3.0:1784404717.468301:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728893952 00000100:00100000:3.0:1784404717.468359:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784404717.468367:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728893952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404717.468380:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404717.468396:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78eb5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.468421:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.468431:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.468441:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167f000, rc 0) 00000100:00100000:3.0:1784404717.468520:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728893952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (4368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404717.468545:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1784404717.468790:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728893952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404717.468807:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.468823:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404717.468941:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.468974:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.468994:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404717.469287:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894080 00000100:00100000:3.0:1784404717.469292:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894080 00000100:00100000:3.0:1784404717.469325:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784404717.469332:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728894080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404717.469441:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728894080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404717.469449:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1784404717.469630:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.469659:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.469699:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.469724:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404717.469762:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894208 00000100:00100000:3.0:1784404717.469766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894208 00000100:00100000:3.0:1784404717.469783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784404717.469789:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728894208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.473647:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728894208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3850us (3939us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404717.473664:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1784404717.473823:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784404717.474763:0:13240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784404717.474970:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784404717.474993:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404717.475003:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.475015:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404717.475025:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784404717.475028:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd544dfc000 from 7 10000000:01000000:2.0:1784404717.475031:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784404717.475061:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.475081:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.475091:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404717.475112:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.475164:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.475212:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404717.475300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894336 00000100:00100000:0.0:1784404717.475366:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894336 00000100:00100000:0.0:1784404717.475416:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1784404717.475425:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728894336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404717.475438:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404717.475451:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd78ec3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404717.475474:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404717.475493:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404717.475502:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b400, rc 0) 00000100:00100000:0.0:1784404717.475755:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728894336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 329us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404717.475763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1784404717.479662:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404717.479695:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404717.479707:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404717.479797:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.480291:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.480430:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404717.484030:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894464 00000100:00100000:3.0:1784404717.484046:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894464 00000100:00100000:2.0:1784404717.486668:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784404717.486684:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728894464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.486872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728894464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (6581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404717.486879:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784404717.491390:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.491589:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404717.491668:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404717.491752:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404717.491879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894592 00000100:00100000:3.0:1784404717.491886:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894592 00000100:00100000:3.0:1784404717.491933:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1784404717.491943:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728894592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404717.492052:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728894592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404717.492060:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784404717.493488:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728894592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784404717.494793:0:13241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784404717.495470:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784404717.495493:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404717.495504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404717.495526:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404717.783839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404717.783890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404717.783910:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404717.783931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404717.783978:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707845504 00000100:00100000:0.0:1784404717.783987:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707845504 00000100:00100000:0.0:1784404717.784043:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707845760 00000100:00100000:0.0:1784404717.784046:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707845760 00000100:00100000:0.0:1784404717.784062:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707845376 00000100:00100000:0.0:1784404717.784065:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707845376 00000100:00100000:0.0:1784404717.784077:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707845632 00000100:00100000:0.0:1784404717.784080:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707845632 00000100:00100000:0.0:1784404717.784096:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:0.0:1784404717.784106:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707845504:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404717.784179:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707845504:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 73us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404717.784186:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:0.0:1784404717.784204:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00100000:0.0:1784404717.784211:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707845760:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404717.784252:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707845760:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 42us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404717.784258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00100000:0.0:1784404717.784269:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 176 00000100:00100000:0.0:1784404717.784274:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707845376:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404717.784296:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707845376:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404717.784301:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 176 00000100:00100000:0.0:1784404717.784311:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 177 00000100:00100000:0.0:1784404717.784316:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707845632:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404717.784335:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707845632:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 19us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404717.784340:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 177 00000100:00080000:0.0:1784404717.784362:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404717.784366:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784404717.832983:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404717.957071:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728894720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404717.957149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404717.957224:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894720 00000100:00100000:1.0:1784404717.957231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894720 00000100:00100000:1.0:1784404717.957274:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784404717.957283:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728894720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404717.957326:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784404717.957372:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728894720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404717.957379:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784404717.957426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728894720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784404718.851475:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404719.875203:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784404719.910170:0:13381:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784404720.515181:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728894848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404720.515260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404720.515462:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894848 00000100:00100000:1.0:1784404720.515470:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894848 00000100:00100000:1.0:1784404720.515552:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784404720.515562:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728894848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404720.515588:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404720.515634:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728894848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404720.515640:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1784404720.515678:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083728894848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404720.515715:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728894848:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784404720.515779:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404720.515918:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728894976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404720.515948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.515983:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728894976 00000100:00100000:0.0:1784404720.515987:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728894976 00000100:00100000:0.0:1784404720.516015:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784404720.516022:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728894976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404720.516048:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404720.516080:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728894976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404720.516095:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1784404720.516110:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784404720.516127:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44365f480 x1871083728894976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404720.516139:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728894976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404720.516321:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728895104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404720.516347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.516884:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728895232:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.516918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.516947:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728895744:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.516966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.516982:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728896256:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.517031:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784404720.517046:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728895360:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.517082:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728895872:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.517117:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728896384:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.517168:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728895744 00000100:00100000:0.0:1784404720.517503:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728895744 00000100:00100000:0.0:1784404720.517545:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784404720.517552:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728895744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517607:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728895744:12345-0@lo:400:kworker.0 Request processed in 55us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404720.517613:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784404720.517633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896256 00000100:00100000:0.0:1784404720.517636:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896256 00000100:00100000:0.0:1784404720.517661:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728895360 00000100:00100000:0.0:1784404720.517663:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728895360 00000100:00100000:0.0:1784404720.517672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728895872 00000100:00100000:0.0:1784404720.517674:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728895872 00000100:00100000:0.0:1784404720.517686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784404720.517691:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728896256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517719:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728896256:12345-0@lo:400:kworker.0 Request processed in 27us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404720.517724:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784404720.517735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784404720.517741:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728895360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517767:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728895360:12345-0@lo:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404720.517773:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784404720.517783:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784404720.517789:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728895872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728895872:12345-0@lo:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404720.517830:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784404720.517884:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896384 00000100:00100000:0.0:1784404720.517888:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896384 00000100:00100000:0.0:1784404720.517917:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784404720.517930:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728896384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.517962:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728896384:12345-0@lo:400:kworker.0 Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404720.517967:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1784404720.517984:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404720.517987:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404720.517990:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404720.518001:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728895616:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.518024:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.518040:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728896128:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.518058:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.518075:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784404720.518081:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728895488:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.518102:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.518119:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728896000:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.518137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404720.518151:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728896512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404720.518170:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404720.518223:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728895232 00000100:00100000:2.0:1784404720.518228:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728895232 00000100:00100000:2.0:1784404720.518260:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784404720.518267:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728895232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518301:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728895232:12345-0@lo:400:kworker.0 Request processed in 35us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404720.518307:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784404720.518384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728895488 00000100:00100000:2.0:1784404720.518388:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728895488 00000100:00100000:2.0:1784404720.518404:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784404720.518409:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728895488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518436:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728895488:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404720.518441:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784404720.518456:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728895616 00000100:00100000:2.0:1784404720.518458:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728895616 00000100:00100000:2.0:1784404720.518473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896128 00000100:00100000:2.0:1784404720.518475:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896128 00000100:00100000:2.0:1784404720.518503:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896000 00000100:00100000:2.0:1784404720.518505:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896000 00000100:00100000:2.0:1784404720.518517:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784404720.518521:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728895616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518555:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728895616:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404720.518561:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784404720.518570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784404720.518575:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728896128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518595:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728896128:12345-0@lo:400:kworker.0 Request processed in 20us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404720.518599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784404720.518607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784404720.518612:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728896000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518631:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728896000:12345-0@lo:400:kworker.0 Request processed in 19us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404720.518635:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784404720.518665:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728895360:0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518674:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728895872:0@lo:400:kworker.0 00010000:00080000:2.0:1784404720.518686:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e5500 x1871083728896384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404720.518696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728896384:0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518704:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728895232:0@lo:400:kworker.0 00000100:00100000:2.0:1784404720.518713:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728895744:0@lo:400:kworker.0 00010000:00080000:2.0:1784404720.518723:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e4a80 x1871083728896256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404720.518742:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728896256:0@lo:400:kworker.0 00000100:00080000:2.0:1784404720.518814:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404720.518818:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404720.519569:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728895616:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.519582:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728896128:0@lo:400:kworker.0 00000100:00100000:0.0:1784404720.519601:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728895488:0@lo:400:kworker.0 00010000:00080000:0.0:1784404720.519612:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e4e00 x1871083728896000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404720.519620:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728896000:0@lo:400:kworker.0 00000100:00100000:3.0:1784404720.519773:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728895104 00000100:00100000:3.0:1784404720.519779:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728895104 00000100:00100000:3.0:1784404720.519831:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896512 00000100:00100000:3.0:1784404720.519835:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896512 00000100:00100000:3.0:1784404720.519868:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784404720.519877:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728895104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404720.519896:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404720.519946:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728895104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (3598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404720.519953:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784404720.519967:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784404720.519973:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728896512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404720.519983:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404720.520007:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728896512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404720.520012:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1784404720.520255:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784404720.520276:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083728896512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404720.520291:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728896512:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1784404720.520302:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443182300 x1871083728895104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404720.520313:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728895104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784404720.904455:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404721.925300:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404722.057065:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404722.057091:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728896640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404722.057176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404722.057235:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896640 00000100:00100000:1.0:1784404722.057243:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896640 00000100:00100000:1.0:1784404722.057292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784404722.057300:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728896640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404722.057336:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784404722.057378:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728896640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404722.057386:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784404722.057434:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728896640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404722.908793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404722.908836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404722.908909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404722.909024:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707846016 00000100:00100000:3.0:1784404722.909034:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707846016 00000100:00100000:1.0:1784404722.909096:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707846272 00000100:00100000:1.0:1784404722.909102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707846272 00000100:00100000:3.0:1784404722.909112:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:3.0:1784404722.909125:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707846016:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404722.909139:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:1.0:1784404722.909149:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707846272:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404722.909208:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707846272:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404722.909215:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:3.0:1784404722.909296:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707846016:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 174us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404722.909318:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00080000:2.0:1784404722.909383:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404722.909759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707845888 00000100:00100000:0.0:1784404722.909764:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707845888 00000100:00100000:0.0:1784404722.909804:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 329 00000100:00100000:0.0:1784404722.909812:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707845888:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404722.909891:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707845888:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 80us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404722.909898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 329 00000100:00100000:2.0:1784404722.916163:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404722.916315:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404722.916605:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707846144 00000100:00100000:1.0:1784404722.916615:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707846144 00000100:00100000:3.0:1784404722.916616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707846400 00000100:00100000:3.0:1784404722.916619:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707846400 00000100:00080000:2.0:1784404722.916679:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404722.916736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:1.0:1784404722.916748:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707846144:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404722.916846:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707846144:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 100us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404722.916897:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:3.0:1784404722.916902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:3.0:1784404722.916911:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707846400:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404722.916940:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707846400:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404722.916947:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 187 00010000:00010000:2.0:1784404722.947638:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404723.075090:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404723.075115:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728896768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404723.075195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404723.078665:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896768 00000100:00100000:1.0:1784404723.078680:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896768 00000100:00100000:3.0:1784404723.085015:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784404723.085029:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728896768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404723.085466:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404723.085567:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728896768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 540us (10373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404723.085575:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784404723.085703:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728896768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784404723.973741:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404724.996048:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784404725.310751:0:13529:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:58:44 (1784404724) === 00000100:00100000:0.0:1784404725.520841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.520980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.521014:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707846656 00000100:00100000:0.0:1784404725.521023:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707846656 00000100:00100000:0.0:1784404725.521085:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1784404725.521097:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:10494:x1871083707846656:12345-192.168.202.42@tcp:700:mkdir.0 00000100:00100000:0.0:1784404725.521187:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:10494:x1871083707846656:12345-192.168.202.42@tcp:700:mkdir.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404725.521195:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00080000:0.0:1784404725.521361:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404725.522471:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707846528 00000100:00100000:1.0:1784404725.522480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707846528 00000100:00100000:1.0:1784404725.522520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1784404725.522529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2402:x1871083707846528:12345-192.168.202.42@tcp:41:mkdir.0 00000004:00000024:1.0:1784404725.522673:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784404725.522749:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2402:x1871083707846528:12345-192.168.202.42@tcp:41:mkdir.0 Request processed in 220us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.522756:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1784404725.525009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404725.527350:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707846912 00000100:00100000:1.0:1784404725.527368:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707846912 00000100:00100000:1.0:1784404725.527446:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1784404725.527459:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:10494:x1871083707846912:12345-192.168.202.42@tcp:36:mkdir.0 00010000:00010000:1.0:1784404725.527523:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404725.527734:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78d73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70c4 expref: 6 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.527753:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd44330fb00) 00010000:00010000:1.0:1784404725.527765:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404725.527875:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.527888:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.527898:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.527928:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.527934:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.527941:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529193:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529385:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529396:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784404725.529414:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000407f9d0 reply state 0000000080470c3c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529424:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529430:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd573868b00) 00010000:00010000:1.0:1784404725.529450:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784404725.529454:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784404725.529460:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784404725.529468:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529473:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529480:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529486:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404725.529490:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529497:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573868600) 00010000:00010000:1.0:1784404725.529509:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404725.529512:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529518:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd78ed1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784404725.529534:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000407f9d0 reply state 0000000080470c3c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529553:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.529568:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd573868e00) 00010000:00010000:1.0:1784404725.529570:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784404725.529573:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784404725.529816:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:10494:x1871083707846912:12345-192.168.202.42@tcp:36:mkdir.0 Request processed in 2284us (4738us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784404725.529825:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1784404725.555800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404725.555911:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707847040 00000100:00100000:3.0:1784404725.555922:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707847040 00000100:00100000:3.0:1784404725.555972:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:3.0:1784404725.555984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:10495:x1871083707847040:12345-192.168.202.42@tcp:101:chmod.0 00010000:00010000:3.0:1784404725.556005:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404725.556032:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78ee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7157 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.556124:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78eed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.556139:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.556152:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404725.556201:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404725.556206:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404725.556239:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.556266:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78ee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7157 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.556281:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78eed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7157 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.556291:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:3.0:1784404725.556295:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404725.556299:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7600, rc 0) 00000100:00100000:3.0:1784404725.556363:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:10495:x1871083707847040:12345-192.168.202.42@tcp:101:chmod.0 Request processed in 381us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.556370:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784404725.560241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404725.560309:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707847296 00000100:00100000:3.0:1784404725.560320:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707847296 00000100:00100000:3.0:1784404725.560390:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:3.0:1784404725.560400:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:10495:x1871083707847296:12345-192.168.202.42@tcp:36:chmod.0 00010000:00010000:3.0:1784404725.560561:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404725.560590:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78eed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7157 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.560611:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:3.0:1784404725.560626:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404725.560662:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.560679:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.560690:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404725.560965:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e74e1c1 reply state 000000004c1bfa71 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.560978:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.560985:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cb00) 00010000:00010000:3.0:1784404725.560987:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784404725.560990:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784404725.560998:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784404725.561119:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:10495:x1871083707847296:12345-192.168.202.42@tcp:36:chmod.0 Request processed in 720us (888us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784404725.561128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:1.0:1784404725.587264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404725.587403:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707847424 00000100:00100000:3.0:1784404725.587414:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707847424 00000100:00100000:3.0:1784404725.587491:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:3.0:1784404725.587502:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:10496:x1871083707847424:12345-192.168.202.42@tcp:101:chown.0 00010000:00010000:3.0:1784404725.587529:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404725.587552:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed715e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.587634:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78f02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.587649:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.587664:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404725.587712:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404725.587717:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404725.587758:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.587786:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed715e expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.587805:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed715e expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.587814:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cb00) 00010000:00010000:3.0:1784404725.587817:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404725.587835:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7800, rc 0) 00000100:00100000:3.0:1784404725.588272:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:10496:x1871083707847424:12345-192.168.202.42@tcp:101:chown.0 Request processed in 771us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.588281:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:3.0:1784404725.590781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.591112:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707847552 00000100:00100000:0.0:1784404725.591124:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707847552 00000100:00100000:0.0:1784404725.591293:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1784404725.591305:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:10496:x1871083707847552:12345-192.168.202.42@tcp:101:chown.0 00010000:00010000:0.0:1784404725.591325:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404725.591347:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd78f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7165 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591429:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591459:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591472:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591484:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591491:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591496:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591580:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd78f1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591588:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd78f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591617:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd78f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404725.591659:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784404725.591663:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404725.591687:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd78f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591710:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591717:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591724:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591730:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404725.591734:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591742:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591752:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cb00) 00010000:00010000:0.0:1784404725.591755:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404725.591760:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591766:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591788:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591794:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591800:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591805:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404725.591808:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591814:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591821:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd573868e00) 00010000:00010000:0.0:1784404725.591823:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404725.591826:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591832:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591887:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd78f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7165 expref: 12 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591901:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd78f1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7165 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.591933:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd573868b00) 00010000:00010000:0.0:1784404725.591936:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404725.591938:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:0.0:1784404725.592013:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:10496:x1871083707847552:12345-192.168.202.42@tcp:101:chown.0 Request processed in 699us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404725.592021:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1784404725.602106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404725.602216:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707847680 00000100:00100000:2.0:1784404725.602227:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707847680 00000100:00100000:2.0:1784404725.602300:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:2.0:1784404725.602316:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:10496:x1871083707847680:12345-192.168.202.42@tcp:900:chown.0 00000100:00100000:2.0:1784404725.602399:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:10496:x1871083707847680:12345-192.168.202.42@tcp:900:chown.0 Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404725.602407:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:1.0:1784404725.607539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404725.607659:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707847936 00000100:00100000:2.0:1784404725.607672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707847936 00000100:00100000:2.0:1784404725.607743:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:2.0:1784404725.607755:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:10496:x1871083707847936:12345-192.168.202.42@tcp:36:chown.0 00010000:00010000:2.0:1784404725.607811:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404725.607904:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd78f1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7165 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.607935:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd573868b00) 00010000:00010000:2.0:1784404725.607940:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404725.607967:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.607982:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.607992:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404725.609939:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1784404725.610134:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610145:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610153:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610159:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404725.610164:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610170:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610186:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd573868e00) 00010000:00010000:2.0:1784404725.610190:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404725.610204:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610210:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78ed8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610234:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784404725.610239:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008671fa33 reply state 00000000a95be628 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610241:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610256:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.610265:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610276:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404725.610277:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd573868b00) 00010000:00010000:1.0:1784404725.610282:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1784404725.610286:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784404725.610287:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610296:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404725.610300:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784404725.610306:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd573868b00) 00010000:00010000:2.0:1784404725.610310:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404725.610314:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610320:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78edf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610334:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610340:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610353:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610357:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404725.610360:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610365:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610373:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cb00) 00010000:00010000:2.0:1784404725.610376:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784404725.610378:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.610384:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd78ef4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784404725.610505:0:6519:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784404725.610526:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:10496:x1871083707847936:12345-192.168.202.42@tcp:36:chown.0 Request processed in 2771us (2994us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784404725.610537:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00010000:00010000:2.0:1784404725.611211:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.611223:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.611228:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.611233:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404725.611237:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.611257:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.611270:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd573868b00) 00010000:00010000:2.0:1784404725.611273:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784404725.611276:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.611282:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404725.626767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404725.627181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707848064 00000100:00100000:2.0:1784404725.627192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707848064 00000100:00100000:2.0:1784404725.627247:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:2.0:1784404725.627256:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:10497:x1871083707848064:12345-192.168.202.42@tcp:101:touch.500 00010000:00010000:2.0:1784404725.627278:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404725.627297:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed716c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784404725.631166:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3810us 00000100:00100000:0.0:1784404725.635100:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728896896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404725.635180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.635381:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404725.635392:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728897024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404725.635421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.635477:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728896896 00000100:00100000:1.0:1784404725.635502:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728896896 00000100:00100000:1.0:1784404725.635567:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897024 00000100:00100000:1.0:1784404725.635570:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897024 00000100:00100000:1.0:1784404725.635592:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784404725.635602:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728896896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784404725.635638:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404725.635687:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728896896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.635695:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784404725.635713:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784404725.635719:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728897024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404725.635729:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404725.635759:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728897024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.635764:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1784404725.635780:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784404725.635812:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435d9500 x1871083728897024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404725.635833:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728897024:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1784404725.636164:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f90000 x1871083728896896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404725.636177:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728896896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404725.636193:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4435d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728897152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404725.636217:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.636239:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897152 00000100:00100000:1.0:1784404725.636249:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897152 00000100:00100000:1.0:1784404725.636275:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784404725.636281:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728897152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404725.636297:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404725.636332:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728897152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.636338:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1784404725.636352:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784404725.636367:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4435d9500 x1871083728897152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404725.636378:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4435d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728897152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404725.637037:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404725.637049:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728897280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404725.637082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404725.637118:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897280 00000100:00100000:3.0:1784404725.637122:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897280 00000100:00100000:3.0:1784404725.637152:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784404725.637159:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728897280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404725.637173:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404725.637202:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728897280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.637208:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1784404725.637265:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784404725.637286:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443182300 x1871083728897280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404725.637300:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728897280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404725.641555:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728897408:0@lo:400:kworker.0 00000100:00100000:0.0:1784404725.641639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.641774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897408 00000100:00100000:1.0:1784404725.641781:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897408 00000100:00100000:1.0:1784404725.641827:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1784404725.641867:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728897408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404725.643054:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728897792:0@lo:400:kworker.0 00000100:00100000:2.0:1784404725.643109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404725.643231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404725.643320:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728897408:12345-0@lo:400:kworker.0 Request processed in 1483us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.643330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1784404725.643382:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728897664:0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.643409:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.643426:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728898176:0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.643457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.643474:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784404725.643480:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728897536:0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.643500:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.643517:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728898048:0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.643550:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.643580:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897664 00000100:00100000:1.0:1784404725.643587:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897664 00000100:00100000:1.0:1784404725.643623:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784404725.643631:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728897664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.643675:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728897664:12345-0@lo:400:kworker.0 Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.643681:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784404725.643697:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897792 00000100:00100000:1.0:1784404725.643700:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897792 00000100:00100000:1.0:1784404725.643714:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898176 00000100:00100000:1.0:1784404725.643716:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898176 00000100:00100000:1.0:1784404725.643734:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897536 00000100:00100000:1.0:1784404725.643736:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897536 00000100:00100000:1.0:1784404725.643745:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898048 00000100:00100000:1.0:1784404725.643747:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898048 00000100:00100000:1.0:1784404725.643759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784404725.643765:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728897792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404725.644260:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728898304:0@lo:400:kworker.0 00000100:00100000:2.0:1784404725.644290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404725.644305:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728897920:0@lo:400:kworker.0 00000100:00100000:2.0:1784404725.644326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404725.644410:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728897408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404725.644898:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728897920 00000100:00100000:3.0:1784404725.644903:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728897920 00000100:00100000:3.0:1784404725.644929:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784404725.644937:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728897920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404725.644992:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728897920:12345-0@lo:400:kworker.0 Request processed in 56us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.644999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1784404725.645018:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404725.645023:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404725.645037:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784404725.645045:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1784404725.645133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898304 00000100:00100000:3.0:1784404725.645137:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898304 00000100:00100000:3.0:1784404725.645158:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784404725.645164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784404725.645170:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728898176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404725.645203:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728898176:12345-0@lo:400:kworker.0 Request processed in 33us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.645209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784404725.645220:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784404725.645225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784404725.645230:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728897536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404725.645254:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728897536:12345-0@lo:400:kworker.0 Request processed in 24us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.645259:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784404725.645269:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784404725.645274:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784404725.645280:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728898048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404725.645307:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728898048:12345-0@lo:400:kworker.0 Request processed in 27us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.645313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784404725.645330:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784404725.645871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1784404725.645880:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728898304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404725.645913:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728898304:12345-0@lo:400:kworker.0 Request processed in 35us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.645919:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1784404725.645936:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404725.646184:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728898432:0@lo:400:kworker.0 00000100:00100000:0.0:1784404725.646218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404725.646310:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728897792:12345-0@lo:400:kworker.0 Request processed in 2543us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.646318:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784404725.646332:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898432 00000100:00100000:1.0:1784404725.646396:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898432 00000100:00100000:1.0:1784404725.646445:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784404725.646452:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728898432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.646487:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728898432:12345-0@lo:400:kworker.0 Request processed in 36us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404725.646493:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784404725.646542:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728897536:0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.646554:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728898048:0@lo:400:kworker.0 00000100:00100000:1.0:1784404725.646565:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728897664:0@lo:400:kworker.0 00010000:00080000:1.0:1784404725.646578:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e29c00 x1871083728898176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404725.646588:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728898176:0@lo:400:kworker.0 00010000:00080000:1.0:1784404725.646623:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e2b100 x1871083728898432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404725.646631:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728898432:0@lo:400:kworker.0 00000100:00080000:0.0:1784404725.646693:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404725.646755:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728897792:0@lo:400:kworker.0 00000100:00100000:2.0:1784404725.646781:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728898304:0@lo:400:kworker.0 00000100:00100000:2.0:1784404725.646790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728897920:0@lo:400:kworker.0 00010000:00010000:3.0:1784404725.652868:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.652892:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.652905:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.652921:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.652929:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.652935:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653035:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd78f41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653044:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd78f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653052:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd78f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404725.653096:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404725.653099:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404725.653135:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd78f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653148:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653155:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653163:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653169:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404725.653173:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653180:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653192:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cb00) 00010000:00010000:3.0:1784404725.653195:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404725.653199:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653205:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78f33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653217:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653232:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653238:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653243:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404725.653246:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653252:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653259:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd54ac1cc00) 00010000:00010000:3.0:1784404725.653261:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404725.653263:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653269:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78f3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653312:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed716c expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653330:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd78f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed716c expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.653500:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:3.0:1784404725.653503:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784404725.653511:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7e00, rc 0) 00000100:00100000:2.0:1784404725.653733:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:10497:x1871083707848064:12345-192.168.202.42@tcp:101:touch.500 Request processed in 26476us (26974us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404725.653743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:0.0:1784404725.656968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404725.657076:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707848320 00000100:00100000:1.0:1784404725.657087:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707848320 00000100:00100000:1.0:1784404725.657153:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:1.0:1784404725.657162:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:10497:x1871083707848320:12345-192.168.202.42@tcp:101:touch.500 00010000:00010000:1.0:1784404725.657185:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404725.657209:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78f48 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7173 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657310:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657325:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657336:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657369:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657378:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657385:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784404725.657772:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784404725.657955:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549400/0x24b3e2e6dcd78f5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657965:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549400/0x24b3e2e6dcd78f5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.657973:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549400/0x24b3e2e6dcd78f5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658005:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658013:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658020:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658027:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404725.658031:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658049:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658062:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:1.0:1784404725.658065:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404725.658070:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658076:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548800/0x24b3e2e6dcd78f4f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784404725.658090:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065b1e5e5 reply state 000000007d783f5e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658100:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658106:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9dd573868600) 00010000:00010000:1.0:1784404725.658108:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784404725.658111:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784404725.658139:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548600/0x24b3e2e6dcd78f48 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7173 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658154:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549400/0x24b3e2e6dcd78f5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7173 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404725.658162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd573868400) 00010000:00010000:1.0:1784404725.658164:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404725.658167:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549400, rc 0) 00000100:00100000:1.0:1784404725.658234:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:10497:x1871083707848320:12345-192.168.202.42@tcp:101:touch.500 Request processed in 1072us (1276us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784404725.658249:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:1.0:1784404725.662766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404725.662896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707848576 00000100:00100000:3.0:1784404725.662906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707848576 00000100:00100000:3.0:1784404725.662966:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:3.0:1784404725.662976:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:10497:x1871083707848576:12345-192.168.202.42@tcp:36:touch.500 00010000:00010000:3.0:1784404725.663036:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404725.663065:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549400/0x24b3e2e6dcd78f5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7173 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.663082:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd573868400) 00010000:00010000:3.0:1784404725.663093:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404725.663155:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.663169:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.663180:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404725.663285:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca9d660e reply state 00000000faa90b64 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.663298:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.663304:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:3.0:1784404725.663307:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404725.663310:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404725.663399:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:10497:x1871083707848576:12345-192.168.202.42@tcp:36:touch.500 Request processed in 423us (642us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784404725.663425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:3.0:1784404725.666306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404725.666384:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707848704 00000100:00100000:2.0:1784404725.666393:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707848704 00000100:00100000:2.0:1784404725.666463:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:2.0:1784404725.666473:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:10497:x1871083707848704:12345-192.168.202.42@tcp:101:touch.500 00010000:00010000:2.0:1784404725.666497:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404725.666520:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed717a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.666577:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed717a expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.666592:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed717a expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.666612:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:2.0:1784404725.666616:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784404725.666620:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391800, rc 0) 00000100:00100000:2.0:1784404725.666685:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:10497:x1871083707848704:12345-192.168.202.42@tcp:101:touch.500 Request processed in 213us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404725.666693:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:1.0:1784404725.670232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.670346:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707848832 00000100:00100000:0.0:1784404725.670357:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707848832 00000100:00100000:0.0:1784404725.670406:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1784404725.670415:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1871083707848832:12345-192.168.202.42@tcp:8:touch.500 00010000:00080000:0.0:1784404725.670464:0:8488:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:0.0:1784404725.670499:0:8488:0:(genops.c:1385:class_connect()) connect: client 1827e730-172d-4769-8ecb-95f4e65fc8a0, cookie 0x24b3e2e6dcd78f79 00002000:00100000:0.0:1784404725.670525:0:8488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1827e730-172d-4769-8ecb-95f4e65fc8a0/ffff9dd574f24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784404725.670537:0:8488:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784404725.670621:0:8488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784404725.670654:0:8488:0:(import.c:65:import_set_state_nolock()) ffff9dd574f21000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404725.670730:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2400:x1871083707848832:12345-192.168.202.42@tcp:8:touch.500 Request processed in 314us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404725.670737:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:3.0:1784404725.673820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.674047:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707848960 00000100:00100000:0.0:1784404725.674057:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707848960 00000100:00100000:0.0:1784404725.674143:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1784404725.674154:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:0:x1871083707848960:12345-192.168.202.42@tcp:2:touch.500 00000100:00080000:3.0:1784404725.674546:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1784404725.683983:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1784404725.684001:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000100:00100000:0.0:1784404725.684636:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:0:x1871083707848960:12345-192.168.202.42@tcp:2:touch.500 Request processed in 10477us (10818us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784404725.684649:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:3.0:1784404725.687143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.687234:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707849216 00000100:00100000:0.0:1784404725.687244:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707849216 00000100:00100000:0.0:1784404725.687302:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1784404725.687312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:10497:x1871083707849216:12345-192.168.202.42@tcp:35:touch.500 00000100:00100000:0.0:1784404725.687664:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:10497:x1871083707849216:12345-192.168.202.42@tcp:35:touch.500 Request processed in 352us (541us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784404725.687672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:2.0:1784404725.698381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.698551:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707849344 00000100:00100000:0.0:1784404725.698564:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707849344 00000100:00100000:0.0:1784404725.698635:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:0.0:1784404725.698646:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:10498:x1871083707849344:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:0.0:1784404725.698685:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404725.698709:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7181 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.698779:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.698794:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.698807:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404725.698918:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784404725.698923:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404725.698959:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.698987:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7181 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.699008:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7181 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.699017:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:0.0:1784404725.699019:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404725.699024:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a600, rc 0) 00000100:00100000:0.0:1784404725.699098:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:10498:x1871083707849344:12345-192.168.202.42@tcp:101:rm.0 Request processed in 452us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404725.699105:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:1.0:1784404725.703106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.703390:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707849600 00000100:00100000:0.0:1784404725.703401:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707849600 00000100:00100000:0.0:1784404725.703479:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:0.0:1784404725.703491:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:10498:x1871083707849600:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:0.0:1784404725.703512:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404725.703534:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7188 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404725.703653:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784404725.703812:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78f8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7188 expref: 16 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.703829:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cb00) 00010000:00010000:0.0:1784404725.703832:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404725.703880:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7188 expref: 16 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.703897:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ae00, rc 0) 00000100:00100000:0.0:1784404725.703960:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:10498:x1871083707849600:12345-192.168.202.42@tcp:101:rm.0 Request processed in 472us (864us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1784404725.703968:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:1.0:1784404725.707548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.707633:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707849728 00000100:00100000:0.0:1784404725.707644:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707849728 00000100:00100000:0.0:1784404725.707756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1784404725.707772:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:10498:x1871083707849728:12345-192.168.202.42@tcp:37:rm.0 00000100:00100000:0.0:1784404725.713263:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:10498:x1871083707849728:12345-192.168.202.42@tcp:37:rm.0 Request processed in 5477us (5706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404725.713299:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:1.0:1784404725.717326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404725.717491:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707849984 00000100:00100000:3.0:1784404725.717504:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707849984 00000100:00100000:3.0:1784404725.717598:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1784404725.717610:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:10498:x1871083707849984:12345-192.168.202.42@tcp:35:rm.0 00000100:00100000:3.0:1784404725.717917:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:10498:x1871083707849984:12345-192.168.202.42@tcp:35:rm.0 Request processed in 308us (602us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784404725.717925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:1.0:1784404725.721540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404725.721650:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707850240 00000100:00100000:2.0:1784404725.721662:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707850240 00000100:00100000:2.0:1784404725.721759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:2.0:1784404725.721771:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:10498:x1871083707850240:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:2.0:1784404725.721799:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404725.721823:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391600/0x24b3e2e6dcd78f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed718f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.721970:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031e00/0x24b3e2e6dcd78fa3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.721986:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031e00/0x24b3e2e6dcd78fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.721999:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031e00/0x24b3e2e6dcd78fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404725.722011:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784404725.722182:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391600/0x24b3e2e6dcd78f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed718f expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.722203:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031e00/0x24b3e2e6dcd78fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed718f expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404725.722212:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:2.0:1784404725.722215:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784404725.722219:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031e00, rc 0) 00000100:00100000:2.0:1784404725.722281:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:10498:x1871083707850240:12345-192.168.202.42@tcp:101:rm.0 Request processed in 512us (750us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784404725.722299:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:1.0:1784404725.724809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.725565:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707850368 00000100:00100000:0.0:1784404725.725576:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707850368 00000100:00100000:0.0:1784404725.725638:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1784404725.725648:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:10498:x1871083707850368:12345-192.168.202.42@tcp:41:rm.0 00000004:00000024:0.0:1784404725.725703:0:9527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1784404725.725768:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:10498:x1871083707850368:12345-192.168.202.42@tcp:41:rm.0 Request processed in 121us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404725.725775:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:1.0:1784404725.728057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404725.728143:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707850496 00000100:00100000:3.0:1784404725.728153:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707850496 00000100:00100000:3.0:1784404725.728203:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:3.0:1784404725.728212:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:10498:x1871083707850496:12345-192.168.202.42@tcp:101:rm.0 00010000:00010000:3.0:1784404725.728230:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404725.728248:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7196 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728315:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728329:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728353:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728379:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728387:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728394:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728488:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd78fc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728498:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd78fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728505:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd78fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404725.728543:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784404725.728548:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404725.728568:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd78fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728581:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd78fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728589:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728594:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728613:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728619:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404725.728622:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728630:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728641:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:3.0:1784404725.728644:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404725.728648:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728655:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78fb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728669:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728675:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728680:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728686:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404725.728689:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728707:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728716:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9dd573868600) 00010000:00010000:3.0:1784404725.728718:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404725.728721:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728726:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78fbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728752:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7196 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728765:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd78fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7196 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.728771:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:3.0:1784404725.728773:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404725.728775:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6a00, rc 0) 00000100:00100000:3.0:1784404725.728834:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:10498:x1871083707850496:12345-192.168.202.42@tcp:101:rm.0 Request processed in 623us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404725.728841:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:1.0:1784404725.731597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.731699:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707850752 00000100:00100000:0.0:1784404725.731710:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707850752 00000100:00100000:0.0:1784404725.731770:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:0.0:1784404725.731781:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:10498:x1871083707850752:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:0.0:1784404725.731831:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784404725.731899:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd78fc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7196 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.731923:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd78f72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed717a expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.731935:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:0.0:1784404725.731945:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd78f87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7181 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.731953:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:0.0:1784404725.731969:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404725.731991:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732003:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732012:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732023:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732029:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732035:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732134:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732143:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732149:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784404725.732386:0:13543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1784404725.732396:0:13543:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343616543934ns, next at 344616542200ns, rc = 0 00010000:00010000:0.0:1784404725.732456:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732476:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732484:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732491:0:13543:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732497:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732503:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732525:0:13543:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404725.732543:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732550:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732555:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732562:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ba00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404725.732566:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732572:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732590:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:0.0:1784404725.732593:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784404725.732596:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732602:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd78fdb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732616:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732622:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732628:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732634:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ae00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404725.732636:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732642:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732650:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:0.0:1784404725.732652:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404725.732655:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732660:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd78fcd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784404725.732694:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ea21ac0 reply state 00000000aa13aa66 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732706:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404725.732711:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9dd573868600) 00010000:00010000:0.0:1784404725.732713:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784404725.732716:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784404725.732787:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:10498:x1871083707850752:12345-192.168.202.42@tcp:36:rm.0 Request processed in 1007us (1199us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784404725.732796:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00010000:00010000:3.0:1784404725.733689:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404725.733699:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.733707:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404725.733720:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.733728:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.733740:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:3.0:1784404725.733743:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784404725.733747:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.733753:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd78fe2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.733767:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404725.733769:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404725.733770:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404725.737202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404725.737365:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707851008 00000100:00100000:0.0:1784404725.737376:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707851008 00000100:00100000:0.0:1784404725.737442:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:0.0:1784404725.737453:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:10498:x1871083707851008:12345-192.168.202.42@tcp:35:rm.0 00000100:00100000:0.0:1784404725.737682:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:10498:x1871083707851008:12345-192.168.202.42@tcp:35:rm.0 Request processed in 231us (489us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784404725.737689:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1784404725.741234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404725.741362:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707851264 00000100:00100000:3.0:1784404725.741373:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707851264 00000100:00100000:3.0:1784404725.741445:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:3.0:1784404725.741457:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:10498:x1871083707851264:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:3.0:1784404725.741520:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784404725.741551:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031e00/0x24b3e2e6dcd78fa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed718f expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741574:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd78f41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed716c expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c900) 00010000:00010000:3.0:1784404725.741597:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd78f02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed715e expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741618:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1cb00) 00010000:00010000:3.0:1784404725.741624:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404725.741647:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741659:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741668:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741681:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741689:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741695:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741768:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741776:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.741782:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404725.742169:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784404725.742187:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742200:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742206:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742212:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404725.742217:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742224:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742233:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9dd54ac1c700) 00010000:00010000:3.0:1784404725.742237:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784404725.742240:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742246:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7600/0x24b3e2e6dcd78ff7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742265:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742271:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742277:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742282:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404725.742292:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742299:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742307:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54ac1c000) 00010000:00010000:3.0:1784404725.742309:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404725.742312:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742317:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd78fe9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404725.742328:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005eae0116 reply state 00000000ce8f56a7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742339:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404725.742345:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd54ac1cd00) 00010000:00010000:3.0:1784404725.742347:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404725.742349:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404725.742426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:10498:x1871083707851264:12345-192.168.202.42@tcp:36:rm.0 Request processed in 971us (1200us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1784404725.742444:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00010000:00010000:1.0:1784404726.019231:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404727.043074:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404727.172732:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404727.172758:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728898560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404727.172828:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404727.173027:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898560 00000100:00100000:2.0:1784404727.173035:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898560 00000100:00100000:2.0:1784404727.173087:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784404727.173097:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728898560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404727.173129:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404727.173182:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728898560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404727.173190:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784404727.173236:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728898560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404728.014331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404728.014385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404728.014425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404728.014458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404728.014473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404728.014522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404728.014612:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707851520 00000100:00100000:2.0:1784404728.014622:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707851520 00000100:00100000:2.0:1784404728.014704:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852032 00000100:00100000:2.0:1784404728.014707:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852032 00000100:00100000:2.0:1784404728.014722:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707851648 00000100:00100000:2.0:1784404728.014724:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707851648 00000100:00100000:2.0:1784404728.014738:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707851904 00000100:00100000:2.0:1784404728.014740:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707851904 00000100:00100000:2.0:1784404728.014765:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:2.0:1784404728.014776:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2402:x1871083707851520:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404728.014889:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2402:x1871083707851520:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 114us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404728.014897:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:2.0:1784404728.014916:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:2.0:1784404728.014923:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707852032:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404728.014959:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707852032:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 37us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404728.014965:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:2.0:1784404728.014978:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:2.0:1784404728.014985:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707851648:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404728.015008:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707851648:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404728.015008:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:2.0:1784404728.015013:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:1.0:1784404728.015017:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707851904:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404728.015030:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707851392 00000100:00100000:2.0:1784404728.015033:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707851392 00000100:00100000:1.0:1784404728.015042:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707851904:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404728.015048:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:2.0:1784404728.015057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 331 00000100:00100000:2.0:1784404728.015063:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2402:x1871083707851392:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404728.015094:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2402:x1871083707851392:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404728.015099:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 331 00000100:00080000:3.0:1784404728.016763:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404728.016771:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404728.016895:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707851776 00000100:00100000:0.0:1784404728.016905:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707851776 00000100:00100000:0.0:1784404728.016977:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1784404728.016988:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707851776:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:3.0:1784404728.017023:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404728.017069:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707851776:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 83us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404728.017078:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00010000:00010000:3.0:1784404728.066977:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404728.210214:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404728.210252:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728898688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404728.210324:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404728.210439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898688 00000100:00100000:0.0:1784404728.210447:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898688 00000100:00100000:0.0:1784404728.210509:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784404728.210537:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728898688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404728.210576:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784404728.210631:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728898688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404728.210639:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784404728.210686:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728898688:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784404729.097989:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404730.118698:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784404730.568624:0:13678:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1784404730.757652:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728898944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404730.757760:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404730.757825:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784404730.757832:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728898816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404730.757888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404730.761032:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898944 00000100:00100000:2.0:1784404730.761046:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898944 00000100:00100000:2.0:1784404730.761181:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728898816 00000100:00100000:2.0:1784404730.761185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728898816 00000100:00100000:2.0:1784404730.761206:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784404730.761217:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728898944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404730.761251:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404730.761668:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728898944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 452us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404730.761676:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784404730.761703:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784404730.761710:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728898816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404730.761727:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404730.761760:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728898816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404730.761766:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1784404730.761786:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404730.761790:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784404730.761830:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443182300 x1871083728898816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404730.761879:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728898816:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1784404730.761895:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca1b480 x1871083728898944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404730.761908:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728898944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404730.763636:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728899072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404730.763711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404730.763799:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899072 00000100:00100000:2.0:1784404730.763807:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899072 00000100:00100000:2.0:1784404730.764074:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784404730.764096:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728899072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404730.764122:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404730.764555:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728899072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 472us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404730.764562:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1784404730.764659:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e6300 x1871083728899072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404730.764680:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728899072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404730.764699:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404730.764706:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728899200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404730.764736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404730.765178:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899200 00000100:00100000:3.0:1784404730.765185:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899200 00000100:00100000:3.0:1784404730.765224:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784404730.765231:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728899200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784404730.765247:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404730.765285:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728899200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404730.765291:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1784404730.765319:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f92680 x1871083728899200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404730.765333:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728899200:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784404730.765365:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404730.765369:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784404730.766318:0:9914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348650465029ns, next at 349650462621ns, rc = 0 00000100:00100000:0.0:1784404730.773150:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728899456:0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.773238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404730.780555:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728899968:0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.780651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404730.780719:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784404730.780732:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728899328:0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.780763:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404730.780786:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728899840:0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.780810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404730.780827:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728900352:0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.780874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404730.780919:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899456 00000100:00100000:0.0:1784404730.780929:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899456 00000100:00100000:0.0:1784404730.780976:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899968 00000100:00100000:0.0:1784404730.780980:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899968 00000100:00100000:0.0:1784404730.781032:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900352 00000100:00100000:0.0:1784404730.781036:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900352 00000100:00100000:0.0:1784404730.781053:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784404730.781062:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728899456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.781122:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728899456:12345-0@lo:400:kworker.0 Request processed in 60us (7883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404730.781130:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784404730.781148:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784404730.781155:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728899968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.781184:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728899968:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404730.781190:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784404730.781203:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784404730.781209:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728900352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.781235:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728900352:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404730.781241:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784404730.781260:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899840 00000100:00100000:0.0:1784404730.781263:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899840 00000100:00100000:0.0:1784404730.781376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784404730.781385:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728899840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.781432:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728899840:12345-0@lo:400:kworker.0 Request processed in 48us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404730.781438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784404730.781496:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728899840:0@lo:400:kworker.0 00010000:00080000:0.0:1784404730.781511:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c62d80 x1871083728900352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404730.781533:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728900352:0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.781549:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728899456:0@lo:400:kworker.0 00000100:00100000:0.0:1784404730.781559:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728899968:0@lo:400:kworker.0 00000004:00080000:3.0:1784404730.781746:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1784404730.781787:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1784404730.781797:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1784404730.781832:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728899584:0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.781887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404730.781913:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728900096:0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.781936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404730.781958:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784404730.781965:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728899712:0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.781985:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404730.782002:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728900224:0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.782022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404730.782050:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899584 00000100:00100000:3.0:1784404730.782054:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899584 00000100:00100000:3.0:1784404730.782078:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784404730.782085:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728899584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.782123:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728899584:12345-0@lo:400:kworker.0 Request processed in 39us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404730.782130:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00010000:3.0:1784404730.782153:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782164:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782173:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782190:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404730.782195:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782203:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782219:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9dd573868600) 00010000:00010000:3.0:1784404730.782223:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404730.782227:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782234:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd78f56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782252:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782259:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782265:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782271:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404730.782274:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782281:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782316:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9dd54ac1cc00) 00010000:00010000:3.0:1784404730.782319:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404730.782322:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782329:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6800/0x24b3e2e6dcd78f6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782348:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782356:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782362:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782368:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404730.782371:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782376:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782383:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff9dd573868600) 00010000:00010000:3.0:1784404730.782385:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404730.782388:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782406:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd78fd4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782434:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782440:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782445:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782451:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404730.782454:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782459:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782467:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9dd54ac1cd00) 00010000:00010000:3.0:1784404730.782470:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404730.782473:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.782479:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6c00/0x24b3e2e6dcd78ff0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404730.782501:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900096 00000100:00100000:3.0:1784404730.782505:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900096 00000100:00100000:3.0:1784404730.782531:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899712 00000100:00100000:3.0:1784404730.782534:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899712 00000100:00100000:1.0:1784404730.782536:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900224 00000100:00100000:1.0:1784404730.782540:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900224 00000100:00100000:3.0:1784404730.782546:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1784404730.782552:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728900096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404730.782561:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784404730.782567:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728899712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.782594:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728900096:12345-0@lo:400:kworker.0 Request processed in 41us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404730.782594:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728899712:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404730.782600:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784404730.782789:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728900480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784404730.782823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404730.782873:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900480 00000100:00100000:0.0:1784404730.782876:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900480 00000100:00100000:0.0:1784404730.782915:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784404730.782921:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728900480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784404730.782947:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1784404730.782986:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a5bdaf6, atime: 0x6a5bdaf6, ctime: 0x6a5bdaf6, blocks: 0x0 00010000:00010000:0.0:1784404730.782994:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404730.783011:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1784404730.783016:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404730.783024:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404730.783045:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404730.783054:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404730.783073:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404730.783092:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784404730.784444:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1784404730.784478:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784404730.784490:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728900224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.784554:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728900224:12345-0@lo:400:kworker.0 Request processed in 68us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404730.784561:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784404730.784628:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728899712:0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.784642:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728900224:0@lo:400:kworker.0 00000100:00100000:3.0:1784404730.784656:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728899584:0@lo:400:kworker.0 00010000:00080000:3.0:1784404730.784674:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c63800 x1871083728900096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404730.784686:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728900096:0@lo:400:kworker.0 00010000:00010000:3.0:1784404730.784730:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404730.784739:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404730.784750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728899328 00010000:00010000:3.0:1784404730.784753:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc0e93230) 00000100:00100000:1.0:1784404730.784757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728899328 00010000:00010000:3.0:1784404730.784758:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.784768:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404730.784801:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1784404730.784808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728899328:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1784404730.784811:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.784819:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd78ffe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404730.784842:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404730.784845:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404730.784846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784404730.784868:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404730.784870:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728899328:12345-0@lo:400:kworker.0 Request processed in 63us (4107us total) trans 0 rc 0/0 00000100:00080000:3.0:1784404730.784873:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404730.784877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1784404730.786026:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728900480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 365us (463us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784404730.786044:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1784404730.786106:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd443c62d80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1784404730.786113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728900480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784404730.786124:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728899328:0@lo:400:kworker.0 00010000:00010000:1.0:1784404731.139769:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784404731.716920:0:13726:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe053037c0 20000000:00000080:0.0:1784404731.716938:0:13726:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd574dae000 uarg=0000000000000000 20000000:01000000:0.0:1784404731.716975:0:13726:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784404731.716981:0:13726:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784404731.716986:0:13726:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1784404731.717847:0:13727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1784404731.718252:0:13726:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1784404731.723741:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1784404731.723779:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1784404731.723793:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1784404731.723809:0:13726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784404731.723830:0:13726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724049:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724431:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724440:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724446:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724452:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724458:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724466:0:13726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724513:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724527:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.724543:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900608:0@lo:104: 00000100:00100000:1.0:1784404731.724619:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404731.724684:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724704:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 23 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.724711:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900736:0@lo:104: 00010000:00010000:1.0:1784404731.724738:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724745:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 23 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.724751:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900864:0@lo:104: 00010000:00010000:1.0:1784404731.724768:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724776:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.724782:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900992:0@lo:104: 00010000:00010000:1.0:1784404731.724801:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.724810:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 12 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.724819:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728901120:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404731.725002:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784404731.725024:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404731.725042:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404731.725049:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404731.725057:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900608 00000100:00100000:3.0:1784404731.725064:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900608 00000100:00100000:3.0:1784404731.725120:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900736 00000100:00100000:3.0:1784404731.725123:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900736 00000100:00100000:3.0:1784404731.725134:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900864 00000100:00100000:3.0:1784404731.725136:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900864 00000100:00100000:3.0:1784404731.725144:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728900992 00000100:00100000:3.0:1784404731.725146:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728900992 00000100:00100000:3.0:1784404731.725173:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784404731.725181:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ece050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:13726:x1871083728900608:12345-0@lo:104: 00010000:00010000:3.0:1784404731.725193:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725255:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404731.725273:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ece050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+6:13726:x1871083728900608:12345-0@lo:104: Request processed in 93us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.725279:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784404731.725324:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784404731.725330:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:13726:x1871083728900736:12345-0@lo:104: 00010000:00010000:3.0:1784404731.725339:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725373:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784404731.725378:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+5:13726:x1871083728900736:12345-0@lo:104: Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.725397:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784404731.725411:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784404731.725416:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:13726:x1871083728900864:12345-0@lo:104: 00010000:00010000:3.0:1784404731.725423:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725456:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784404731.725461:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+4:13726:x1871083728900864:12345-0@lo:104: Request processed in 46us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.725466:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784404731.725478:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784404731.725484:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:13726:x1871083728900992:12345-0@lo:104: 00010000:00010000:3.0:1784404731.725490:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725515:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784404731.725526:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+3:13726:x1871083728900992:12345-0@lo:104: Request processed in 42us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.725532:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1784404731.725550:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784404731.725556:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725563:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404731.725567:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725575:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404731.725583:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404731.725589:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784404731.725621:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725627:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404731.725646:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725652:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541391200/0x24b3e2e6dcd78ec3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78eca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725666:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784404731.725670:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725688:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404731.725691:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725699:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404731.725704:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404731.725709:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784404731.725724:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725729:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404731.725735:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725741:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541390600/0x24b3e2e6dcd78eb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ebc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725750:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784404731.725753:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725759:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404731.725761:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725776:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404731.725781:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404731.725786:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784404731.725798:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725803:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404731.725820:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725826:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd541391000/0x24b3e2e6dcd78ea7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78eae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725835:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404731.725838:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725843:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404731.725847:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725886:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404731.725892:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404731.725904:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784404731.725919:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725926:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404731.725933:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725939:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd54167e400/0x24b3e2e6dcd78e99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd78ea0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.725954:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404731.725956:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404731.725957:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404731.725964:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404731.725986:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728901248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404731.726020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404731.726056:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404731.726063:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728901376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404731.726085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404731.726111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728901504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404731.726132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404731.726150:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404731.726155:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728901632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404731.726173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404731.726201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728901248 00000100:00100000:3.0:1784404731.726205:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728901248 00010000:00010000:3.0:1784404731.726233:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 24 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404731.726250:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728901376 00000100:00100000:3.0:1784404731.726252:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728901376 00010000:00010000:3.0:1784404731.726263:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 25 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404731.726271:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728901504 00000100:00100000:3.0:1784404731.726274:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728901504 00010000:00010000:3.0:1784404731.726281:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 26 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404731.726291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728901632 00000100:00100000:3.0:1784404731.726293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728901632 00010000:00010000:3.0:1784404731.726302:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 27 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404731.726312:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784404731.726317:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+27:3648:x1871083728901248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404731.726328:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404731.726332:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 27 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726343:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 27 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726360:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404731.726402:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+27:3648:x1871083728901248:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.726408:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784404731.726430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784404731.726437:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+26:3648:x1871083728901376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404731.726446:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404731.726450:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 26 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726457:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 26 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726466:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404731.726488:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+26:3648:x1871083728901376:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.726493:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784404731.726505:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784404731.726511:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+25:3646:x1871083728901504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404731.726519:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404731.726522:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 25 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726529:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 25 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726538:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404731.726562:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+25:3646:x1871083728901504:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.726567:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784404731.726578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784404731.726584:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728901632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404731.726600:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404731.726605:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 24 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726614:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 24 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404731.726624:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404731.726646:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728901632:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404731.726652:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784404731.726693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728901376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404731.726701:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728901248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404731.726724:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728901632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404731.726731:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728901504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404731.726913:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404731.727223:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.727247:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.727260:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728901760:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404731.727300:0:13726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478600 going to sleep for 11 seconds 00010000:00010000:1.0:1784404731.727317:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd78eca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ec3 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.727329:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900608:0@lo:104: 00010000:00010000:1.0:1784404731.727339:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54167f000/0x24b3e2e6dcd78ebc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78eb5 expref: 22 pid: 6511 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.727347:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900736:0@lo:104: 00010000:00010000:1.0:1784404731.727355:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54167fc00/0x24b3e2e6dcd78eae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78ea7 expref: 21 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.727362:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900864:0@lo:104: 00010000:00010000:1.0:1784404731.727371:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548200/0x24b3e2e6dcd78ea0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd78e99 expref: 20 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404731.727379:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728900992:0@lo:104: 00000100:00100000:3.0:1784404731.731722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404731.731877:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728901120:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404731.731892:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871083728901760:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404731.731931:0:13726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404731.732760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404731.734554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852160 00000100:00100000:2.0:1784404731.734569:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852160 00010000:00010000:2.0:1784404731.734620:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404731.734835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852288 00000100:00100000:2.0:1784404731.734871:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852288 00010000:00010000:2.0:1784404731.734887:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 14 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404731.734944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:0.0:1784404731.734960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+14:2404:x1871083707852160:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404731.734977:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404731.734983:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 14 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.734995:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 14 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735022:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54167e200/0x24b3e2e6dcd78e92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7150 expref: 14 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735041:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404731.735102:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707852160:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 147us (3390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404731.735109:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:0.0:1784404731.735128:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:0.0:1784404731.735135:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:2404:x1871083707852288:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404731.735142:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404731.735147:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735164:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735174:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151bc00/0x24b3e2e6dcd78e8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7149 expref: 12 pid: 6511 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735186:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735194:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735210:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735227:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735234:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735240:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735247:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404731.735252:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735260:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735273:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404731.735285:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404731.735308:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:2404:x1871083707852288:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 173us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404731.735314:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00010000:00010000:1.0:1784404731.735509:0:13726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.735518:0:13726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404731.735525:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd79005 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.164433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404732.291031:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404732.291059:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728901888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404732.291150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404732.291389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728901888 00000100:00100000:2.0:1784404732.291399:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728901888 00000100:00100000:2.0:1784404732.291469:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784404732.291481:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728901888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404732.291525:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404732.291598:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728901888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404732.291606:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784404732.291653:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728901888:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1784404732.783075:0:13775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec88e2120 20000000:00000080:3.0:1784404732.783094:0:13775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd443692c00 uarg=0000000000000000 20000000:01000000:3.0:1784404732.783140:0:13775:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1784404732.783146:0:13775:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1784404732.783151:0:13775:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1784404732.792437:0:13776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1784404732.795615:0:13775:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1784404732.795829:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1784404732.795906:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1784404732.795928:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1784404732.795941:0:13775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784404732.795964:0:13775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.795982:0:13775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.795993:0:13775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796000:0:13775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796023:0:13775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796030:0:13775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796037:0:13775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540030800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404732.796041:0:13775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796050:0:13775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796064:0:13775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796073:0:13775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.796079:0:13775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7900c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404732.877541:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784404732.877548:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442280800 from 7 10000000:01000000:1.0:1784404732.877552:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404732.877599:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.877611:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.877622:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404732.877654:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404732.877726:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404732.877994:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546770f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404732.878044:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902016 00000100:00100000:2.0:1784404732.878053:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902016 00000100:00100000:2.0:1784404732.878118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1784404732.878128:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:6517:x1871083728902016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404732.878141:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404732.878156:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7901a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79013 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.878194:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7901a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79013 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.878204:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7901a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79013 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.878213:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540030800, rc 0) 00000100:00100000:2.0:1784404732.878265:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728902016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404732.878282:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784404732.879218:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404732.879248:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.879259:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404732.880100:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404732.880163:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404732.880200:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546770540 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.880517:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902144 00000100:00100000:3.0:1784404732.880525:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902144 00000100:00100000:3.0:1784404732.880571:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1784404732.880581:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728902144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.880705:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728902144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.880712:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784404732.881471:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404732.881514:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404732.881561:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404732.881596:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546770540 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.881638:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902272 00000100:00100000:3.0:1784404732.881643:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902272 00000100:00100000:3.0:1784404732.881679:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1784404732.881687:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728902272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.881775:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728902272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.881781:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1784404732.883255:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404732.883730:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13782:1871083728902400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404732.883790:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404732.883826:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546770cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.883887:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902400 00000100:00100000:3.0:1784404732.883893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902400 00000100:00100000:3.0:1784404732.883932:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1784404732.883941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:13782:x1871083728902400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404732.884043:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:13782:x1871083728902400:12345-0@lo:502:llog_process_th.0 Request processed in 103us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.884050:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784404732.884208:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13782:1871083728902400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784404732.884230:0:13782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404732.884239:0:13782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404732.884242:0:13782:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784404732.884249:0:13782:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd442280800 00000020:00000080:1.0:1784404732.884252:0:13782:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784404732.884441:0:13782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404732.884446:0:13782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404732.884448:0:13782:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784404732.884451:0:13782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404732.884454:0:13782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404732.884455:0:13782:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784404732.884459:0:13782:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd442280800 00000020:00000080:1.0:1784404732.884461:0:13782:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784404732.884497:0:13782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13782:1871083728902528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404732.884532:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404732.884562:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902528 00000100:00100000:1.0:1784404732.884566:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902528 00000100:00100000:1.0:1784404732.884589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1784404732.884596:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:13782:x1871083728902528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404732.884659:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:13782:x1871083728902528:12345-0@lo:502:llog_process_th.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404732.884665:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1784404732.884694:0:13782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546770cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404732.884706:0:13782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13782:1871083728902528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784404732.884723:0:13782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404732.884727:0:13782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404732.884728:0:13782:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784404732.884732:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1784404732.892662:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1784404732.892701:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404732.892714:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.892727:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404732.892739:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784404732.892742:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd574d3a800 from 7 10000000:01000000:2.0:1784404732.892745:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784404732.892799:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.892809:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.892821:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404732.892880:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784404732.892957:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404732.893007:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44247e240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404732.893298:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902656 00000100:00100000:1.0:1784404732.893384:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902656 00000100:00100000:1.0:1784404732.893445:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1784404732.893454:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:6517:x1871083728902656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404732.893468:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404732.893482:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd79028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79021 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.893507:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd79028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79021 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.893516:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd79028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79021 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.893525:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549400, rc 0) 00000100:00100000:1.0:1784404732.893570:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728902656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404732.893585:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1784404732.896495:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404732.896525:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404732.896538:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404732.896618:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404732.896675:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404732.896715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902784 00000100:00100000:2.0:1784404732.896720:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902784 00000100:00100000:2.0:1784404732.896762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784404732.896771:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728902784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404732.896899:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728902784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404732.896907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784404732.896951:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44247e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404732.896963:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404732.896988:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404732.897023:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404732.897040:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728902912 00000100:00100000:2.0:1784404732.897048:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728902912 00000100:00100000:2.0:1784404732.897069:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1784404732.897074:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728902912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404732.897139:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728902912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404732.897145:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1784404732.897176:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44247e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404732.897189:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728902912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404732.909035:0:13784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13784:1871083728903040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404732.909139:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404732.909184:0:13784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404732.909392:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903040 00000100:00100000:2.0:1784404732.909400:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903040 00000100:00100000:2.0:1784404732.909457:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1784404732.909468:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:13784:x1871083728903040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404732.909591:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:13784:x1871083728903040:12345-0@lo:502:llog_process_th.0 Request processed in 125us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404732.909599:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1784404732.910256:0:13784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13784:1871083728903040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784404732.910298:0:13784:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404732.910398:0:13784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404732.910401:0:13784:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784404732.910410:0:13784:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd574d3a800 00000020:00000080:0.0:1784404732.910412:0:13784:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404732.910482:0:13784:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404732.910486:0:13784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404732.910487:0:13784:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784404732.910490:0:13784:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404732.910493:0:13784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404732.910494:0:13784:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784404732.910498:0:13784:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd574d3a800 00000020:00000080:0.0:1784404732.910501:0:13784:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784404732.910547:0:13784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13784:1871083728903168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404732.910598:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404732.910625:0:13784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404732.911718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903168 00000100:00100000:0.0:1784404732.911729:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903168 00000100:00100000:0.0:1784404732.911782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784404732.911791:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:13784:x1871083728903168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404732.911959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:13784:x1871083728903168:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404732.911967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784404732.912022:0:13784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13784:1871083728903168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784404732.912049:0:13784:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404732.912056:0:13784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404732.913402:0:13784:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784404732.913416:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784404732.913782:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784404732.913806:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404732.913817:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.913830:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404732.913841:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784404732.913844:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd565e88000 from 7 10000000:01000000:3.0:1784404732.913847:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784404732.913905:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.913914:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.913925:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404732.913950:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.914004:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.914044:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404732.914436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903296 00000100:00100000:1.0:1784404732.914443:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903296 00000100:00100000:1.0:1784404732.914484:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1784404732.914492:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:6517:x1871083728903296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404732.914504:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404732.914515:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548600/0x24b3e2e6dcd79036 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7902f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.914537:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548600/0x24b3e2e6dcd79036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7902f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.914547:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548600/0x24b3e2e6dcd79036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7902f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.914556:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548600, rc 0) 00000100:00100000:1.0:1784404732.914597:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728903296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404732.914603:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1784404732.914688:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404732.914702:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.914711:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404732.914781:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.914816:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.914841:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404732.916477:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903424 00000100:00100000:1.0:1784404732.916489:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903424 00000100:00100000:1.0:1784404732.916559:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1784404732.916569:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728903424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404732.916715:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728903424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404732.916722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1784404732.916952:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.916998:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.917047:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404732.917441:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903552 00000100:00100000:2.0:1784404732.917446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903552 00000100:00100000:2.0:1784404732.917473:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784404732.917480:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728903552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404732.917561:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728903552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404732.917567:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1784404732.919273:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.919397:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.919634:0:13787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13787:1871083728903680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404732.919699:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.919721:0:13787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c540 going to sleep for 11 seconds 00000100:00100000:2.0:1784404732.919825:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903680 00000100:00100000:2.0:1784404732.919832:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903680 00000100:00100000:2.0:1784404732.919888:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784404732.919897:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:13787:x1871083728903680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404732.920009:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:13787:x1871083728903680:12345-0@lo:502:llog_process_th.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404732.920016:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000040:00080000:1.0:1784404732.920249:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784404732.920436:0:13787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13787:1871083728903680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404732.920463:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404732.920472:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.920475:0:13787:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784404732.920485:0:13787:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd565e88000 00000020:00000080:3.0:1784404732.920488:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784404732.920549:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404732.920553:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.920555:0:13787:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784404732.920558:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404732.920560:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.920562:0:13787:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784404732.920566:0:13787:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd565e88000 00000020:00000080:3.0:1784404732.920568:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784404732.920615:0:13787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13787:1871083728903808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404732.920656:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.920680:0:13787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c540 going to sleep for 11 seconds 00000100:00100000:1.0:1784404732.921445:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903808 00000100:00100000:1.0:1784404732.921454:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903808 00000100:00100000:1.0:1784404732.923158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1784404732.923174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:13787:x1871083728903808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404732.923336:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:13787:x1871083728903808:12345-0@lo:502:llog_process_th.0 Request processed in 167us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404732.923344:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1784404732.924233:0:13787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13787:1871083728903808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404732.924273:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404732.924281:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.924284:0:13787:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784404732.924292:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1784404732.924503:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1784404732.924526:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784404732.924538:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.924549:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404732.924560:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784404732.924564:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd544dfc000 from 7 10000000:01000000:1.0:1784404732.924566:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404732.924600:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.924608:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404732.924617:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404732.924639:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404732.924689:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404732.924743:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443542600 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.924791:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728903936 00000100:00100000:3.0:1784404732.924797:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728903936 00000100:00100000:3.0:1784404732.924840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784404732.924871:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:6517:x1871083728903936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404732.924882:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404732.924895:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c6c00/0x24b3e2e6dcd79044 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7903d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.924919:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c6c00/0x24b3e2e6dcd79044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7903d expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.924930:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c6c00/0x24b3e2e6dcd79044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7903d expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.924940:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6c00, rc 0) 00000100:00100000:3.0:1784404732.924980:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728903936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.924987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784404732.925022:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728903936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404732.925036:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.925052:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404732.925121:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728904064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.925145:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.925158:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.925169:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904064 00000100:00100000:3.0:1784404732.925172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904064 00000100:00100000:3.0:1784404732.925189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1784404732.925194:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728904064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.925326:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728904064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.925333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1784404732.925360:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728904064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.925397:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728904192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.925433:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.925446:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.925457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904192 00000100:00100000:3.0:1784404732.925460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904192 00000100:00100000:3.0:1784404732.925477:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1784404732.925482:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728904192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.925552:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:6517:x1871083728904192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.925559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1784404732.925600:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:6517:1871083728904192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404732.925783:0:13788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13788:1871083728904320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404732.925818:0:13788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.925837:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904320 00000100:00100000:3.0:1784404732.925841:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904320 00000100:00100000:3.0:1784404732.925883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1784404732.925890:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:13788:x1871083728904320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404732.925959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:13788:x1871083728904320:12345-0@lo:502:llog_process_th.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.925965:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1784404732.925992:0:13788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.926004:0:13788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13788:1871083728904320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404732.926026:0:13788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404732.926035:0:13788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.926039:0:13788:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784404732.926048:0:13788:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd544dfc000 00000020:00000080:3.0:1784404732.926050:0:13788:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784404732.926103:0:13788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404732.926107:0:13788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.926108:0:13788:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784404732.926111:0:13788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404732.926114:0:13788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.926115:0:13788:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784404732.926119:0:13788:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd544dfc000 00000020:00000080:3.0:1784404732.926121:0:13788:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784404732.926152:0:13788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13788:1871083728904448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404732.926184:0:13788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404732.926210:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904448 00000100:00100000:3.0:1784404732.926214:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904448 00000100:00100000:3.0:1784404732.926231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1784404732.926236:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:13788:x1871083728904448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404732.926293:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:13788:x1871083728904448:12345-0@lo:502:llog_process_th.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404732.926300:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1784404732.926324:0:13788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404732.926335:0:13788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:13788:1871083728904448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404732.926353:0:13788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404732.926358:0:13788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404732.926359:0:13788:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784404732.926365:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784404732.926443:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784404732.926465:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404732.926474:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404732.926486:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784404732.953937:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784404733.132172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404733.132292:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852416 00000100:00100000:3.0:1784404733.132311:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852416 00000100:00100000:3.0:1784404733.132383:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 353 00000100:00100000:3.0:1784404733.132394:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:6173:x1871083707852416:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404733.132575:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404733.132594:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c7600/0x24b3e2e6dcd7904b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed719d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404733.132637:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c7600/0x24b3e2e6dcd7904b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed719d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404733.132649:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c7600/0x24b3e2e6dcd7904b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed719d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404733.132659:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7600, rc 0) 00000100:00100000:3.0:1784404733.133079:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707852416:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 686us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404733.133087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 353 00000100:00100000:1.0:1784404733.133284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404733.133416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404733.133442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404733.133462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404733.133483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404733.133505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852544 00000100:00100000:1.0:1784404733.133510:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852544 00000100:00100000:1.0:1784404733.133550:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853056 00000100:00100000:1.0:1784404733.133553:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853056 00000100:00100000:1.0:1784404733.133566:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852672 00000100:00100000:1.0:1784404733.133568:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852672 00000100:00100000:1.0:1784404733.133581:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852928 00000100:00100000:1.0:1784404733.133583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852928 00000100:00100000:1.0:1784404733.133598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 204 00000100:00100000:1.0:1784404733.133605:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707852544:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404733.133651:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707852544:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 45us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404733.133658:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 204 00000100:00100000:1.0:1784404733.133671:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 205 00000100:00100000:1.0:1784404733.133678:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707853056:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404733.133699:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707853056:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404733.133704:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 205 00000100:00100000:1.0:1784404733.133715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 206 00000100:00100000:1.0:1784404733.133720:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707852672:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404733.133754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707852672:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 34us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404733.133770:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 206 00000100:00100000:1.0:1784404733.133783:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 207 00000100:00100000:1.0:1784404733.133789:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707852928:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404733.133814:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707852928:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404733.133819:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 207 00000100:00080000:1.0:1784404733.133842:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404733.133845:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404733.134294:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707852800 00000100:00100000:0.0:1784404733.134299:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707852800 00000100:00100000:0.0:1784404733.134355:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1784404733.134364:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707852800:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404733.134408:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707852800:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 47us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404733.134415:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00080000:1.0:1784404733.134510:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404733.138223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404733.140146:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853184 00000100:00100000:2.0:1784404733.140160:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853184 00000100:00100000:2.0:1784404733.140273:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 354 00000100:00100000:2.0:1784404733.140284:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707853184:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404733.140468:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707853184:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 185us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404733.140476:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 354 00000100:00100000:2.0:1784404733.142462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404733.142671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853312 00000100:00100000:3.0:1784404733.142681:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853312 00000100:00100000:3.0:1784404733.142737:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 355 00000100:00100000:3.0:1784404733.142747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707853312:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404733.143149:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707853312:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 402us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404733.143157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 355 00000100:00100000:3.0:1784404733.146391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404733.146489:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853440 00000100:00100000:2.0:1784404733.146498:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853440 00000100:00100000:2.0:1784404733.146546:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 356 00000100:00100000:2.0:1784404733.146553:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:10782:x1871083707853440:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784404733.146701:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:10782:x1871083707853440:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 147us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404733.146710:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 356 00000100:00100000:1.0:1784404733.164260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404733.164439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853568 00000100:00100000:3.0:1784404733.164449:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853568 00000100:00100000:3.0:1784404733.164572:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 357 00000100:00100000:3.0:1784404733.164584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:10782:x1871083707853568:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784404733.164767:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:10782:x1871083707853568:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 180us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404733.164775:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 357 00000100:00100000:3.0:1784404733.173425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404733.174165:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853696 00000100:00100000:1.0:1784404733.174180:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853696 00000100:00100000:1.0:1784404733.174252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 358 00000100:00100000:1.0:1784404733.174264:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:6173:x1871083707853696:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404733.174284:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404733.174497:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd79052 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404733.174540:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd79052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71a4 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404733.174552:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd79052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71a4 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404733.174573:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548400, rc 0) 00000100:00100000:1.0:1784404733.174647:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707853696:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 386us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404733.174669:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 358 00000100:00100000:1.0:1784404733.186687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404733.187479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853824 00000100:00100000:3.0:1784404733.187491:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853824 00000100:00100000:3.0:1784404733.187562:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 359 00000100:00100000:3.0:1784404733.187573:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707853824:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404733.187738:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707853824:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 167us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404733.187746:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 359 00010000:00010000:3.0:1784404733.187820:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404733.190772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404733.191022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707853952 00000100:00100000:1.0:1784404733.191034:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707853952 00000100:00100000:1.0:1784404733.191100:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 360 00000100:00100000:1.0:1784404733.191110:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707853952:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404733.191303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:6173:x1871083707853952:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 193us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404733.191312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 360 00000100:00100000:2.0:1784404733.199847:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404733.199990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854080 00000100:00100000:3.0:1784404733.200001:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854080 00000100:00100000:3.0:1784404733.200063:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 361 00000100:00100000:3.0:1784404733.200078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:10786:x1871083707854080:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784404733.200241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:10786:x1871083707854080:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 165us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404733.200249:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 361 00000100:00100000:3.0:1784404733.205026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404733.206489:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854208 00000100:00100000:2.0:1784404733.206504:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854208 00000100:00100000:2.0:1784404733.206579:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 362 00000100:00100000:2.0:1784404733.206590:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:10786:x1871083707854208:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784404733.206774:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:10786:x1871083707854208:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 185us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404733.206790:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 362 00000100:00100000:2.0:1784404733.315092:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728904576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404733.315191:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404733.315425:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904576 00000100:00100000:3.0:1784404733.315433:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904576 00000100:00100000:3.0:1784404733.315490:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784404733.315500:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728904576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404733.315535:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404733.318458:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728904576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2947us (3254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404733.318474:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784404733.318696:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728904576:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1784404733.955665:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784404733.957705:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784404734.211043:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404735.235003:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404735.875295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728904704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404735.875387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404735.875477:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404735.875484:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728904832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404735.875521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404735.875565:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904704 00000100:00100000:3.0:1784404735.875573:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904704 00000100:00100000:3.0:1784404735.875622:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904832 00000100:00100000:3.0:1784404735.875626:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904832 00000100:00100000:3.0:1784404735.875644:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784404735.875654:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728904704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404735.875685:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404735.875732:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728904704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404735.875739:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784404735.875757:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784404735.875763:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728904832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404735.875782:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404735.875809:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728904832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404735.875815:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784404735.876305:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404735.876319:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728904960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404735.876364:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404735.876402:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728904960 00000100:00100000:2.0:1784404735.876406:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728904960 00000100:00080000:1.0:1784404735.876785:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404735.876790:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404735.876797:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404735.876808:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728905088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404735.876874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404735.876902:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905088 00000100:00100000:1.0:1784404735.876906:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905088 00000100:00080000:0.0:1784404735.876984:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404735.877074:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728905344:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877126:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728905856:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877163:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784404735.877169:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728905216:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877196:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877221:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728905728:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877262:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728906240:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877308:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728905600:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877330:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877360:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728906112:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877381:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877400:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784404735.877414:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728905472:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877438:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877455:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728905984:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877474:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404735.877493:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905344 00000100:00100000:0.0:1784404735.877498:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905344 00000100:00100000:0.0:1784404735.877520:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905856 00000100:00100000:0.0:1784404735.877522:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905856 00000100:00100000:0.0:1784404735.877539:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728906240 00000100:00100000:0.0:1784404735.877542:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728906240 00000100:00100000:0.0:1784404735.877552:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905600 00000100:00100000:0.0:1784404735.877554:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905600 00000100:00100000:0.0:1784404735.877563:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728906112 00000100:00100000:0.0:1784404735.877565:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728906112 00000100:00100000:0.0:1784404735.877576:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905984 00000100:00100000:0.0:1784404735.877578:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905984 00000100:00100000:0.0:1784404735.877593:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784404735.877601:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728905344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877650:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728905344:12345-0@lo:400:kworker.0 Request processed in 49us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.877657:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784404735.877674:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784404735.877680:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728905856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877705:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728905856:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.877711:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784404735.877722:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784404735.877728:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728906240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877766:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728906240:12345-0@lo:400:kworker.0 Request processed in 38us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.877772:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784404735.877784:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784404735.877790:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728905600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877818:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728905600:12345-0@lo:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.877823:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784404735.877835:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784404735.877840:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728906112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877895:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728906112:12345-0@lo:400:kworker.0 Request processed in 55us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.877901:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784404735.877912:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784404735.877917:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728905984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.877943:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728905984:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.877949:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1784404735.877964:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404735.877968:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784404735.877995:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c61500 x1871083728906240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404735.878008:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728906240:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878021:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728905344:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728905856:0@lo:400:kworker.0 00010000:00080000:0.0:1784404735.878071:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c61880 x1871083728905984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404735.878080:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728905984:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878090:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728905600:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878098:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728906112:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878144:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905216 00000100:00100000:0.0:1784404735.878148:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905216 00000100:00100000:0.0:1784404735.878178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1784404735.878184:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728905216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878221:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728905216:12345-0@lo:400:kworker.0 Request processed in 36us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.878226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1784404735.878259:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728905216:0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878290:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905728 00000100:00100000:0.0:1784404735.878293:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905728 00000100:00100000:0.0:1784404735.878313:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728905472 00000100:00100000:0.0:1784404735.878316:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728905472 00000100:00100000:0.0:1784404735.878330:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784404735.878336:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728905728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878393:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728905728:12345-0@lo:400:kworker.0 Request processed in 56us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.878399:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784404735.878414:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784404735.878426:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728905472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404735.878459:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728905472:12345-0@lo:400:kworker.0 Request processed in 34us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404735.878464:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784404735.878465:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728904832:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784404735.878478:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e5880 x1871083728904704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404735.878484:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728905728:0@lo:400:kworker.0 00000100:00100000:3.0:1784404735.878490:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728904704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404735.878504:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728905472:0@lo:400:kworker.0 00000100:00100000:2.0:1784404735.881148:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784404735.881170:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728904960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404735.881197:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404735.881290:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728904960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (4925us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404735.881299:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1784404735.881392:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4432e6300 x1871083728904960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404735.881412:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4432e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728904960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404735.882837:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784404735.882871:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728905088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784404735.882901:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404735.882981:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728905088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (6106us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404735.882987:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784404735.883048:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728905088:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1784404735.887071:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1784404736.259035:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404737.285388:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404737.411428:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404737.411460:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728906368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404737.411706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404737.412468:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728906368 00000100:00100000:0.0:1784404737.412479:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728906368 00000100:00100000:0.0:1784404737.412540:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784404737.412551:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728906368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404737.412586:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404737.412655:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728906368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404737.412662:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784404737.416660:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728906368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404738.253715:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404738.253761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404738.253806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404738.253829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404738.253884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404738.253910:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404738.254189:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854592 00000100:00100000:1.0:1784404738.254198:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854592 00000100:00100000:1.0:1784404738.254268:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854848 00000100:00100000:1.0:1784404738.254271:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854848 00000100:00100000:1.0:1784404738.254285:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854464 00000100:00100000:1.0:1784404738.254288:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854464 00000100:00100000:1.0:1784404738.254300:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854976 00000100:00100000:1.0:1784404738.254302:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854976 00000100:00100000:1.0:1784404738.254319:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 214 00000100:00100000:1.0:1784404738.254349:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707854592:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404738.254426:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707854592:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 99us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404738.254434:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 214 00000100:00100000:1.0:1784404738.254451:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 215 00000100:00100000:1.0:1784404738.254458:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707854848:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404738.254481:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707854848:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404738.254488:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 215 00000100:00100000:1.0:1784404738.254499:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 216 00000100:00100000:1.0:1784404738.254505:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707854464:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404738.254527:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707854464:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404738.254533:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 216 00000100:00100000:1.0:1784404738.254544:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 217 00000100:00100000:1.0:1784404738.254549:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707854976:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404738.254587:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707854976:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404738.254594:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 217 00000100:00080000:3.0:1784404738.254954:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404738.254960:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404738.255479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854336 00000100:00100000:2.0:1784404738.255488:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854336 00000100:00100000:2.0:1784404738.255545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 364 00000100:00100000:2.0:1784404738.255554:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707854336:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404738.255609:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707854336:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 56us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404738.255630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 364 00000100:00100000:0.0:1784404738.256668:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707854720 00000100:00100000:0.0:1784404738.256678:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707854720 00000100:00100000:0.0:1784404738.256769:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:0.0:1784404738.256779:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707854720:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404738.257109:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707854720:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 331us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404738.257116:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00080000:3.0:1784404738.258452:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784404738.307075:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404738.435281:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728906496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404738.435379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404738.435814:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728906496 00000100:00100000:0.0:1784404738.435823:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728906496 00000100:00100000:0.0:1784404738.435908:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784404738.435918:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728906496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404738.435969:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784404738.436288:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728906496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 370us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404738.436296:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784404738.448294:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728906496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784404739.331100:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404740.356230:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404740.995527:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404740.995550:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728906624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404740.995617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404740.995699:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728906624 00000100:00100000:1.0:1784404740.995707:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728906624 00000100:00100000:1.0:1784404740.995757:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784404740.995766:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728906624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404740.995793:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404740.995836:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728906624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404740.995844:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784404740.995912:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728906624:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784404740.996139:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404740.996347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404740.996359:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728906752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404740.996392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.996539:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728906752 00000100:00100000:3.0:1784404740.996544:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728906752 00000100:00100000:3.0:1784404740.996585:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784404740.996593:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728906752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784404740.996606:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404740.996643:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728906752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404740.996649:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784404740.996674:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1784404740.996679:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd443c62d80, transno 4294967301 00000100:00100000:3.0:1784404740.996694:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728906752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404740.996931:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728907136:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.996960:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.996979:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728907648:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.997003:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.997025:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728908160:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.997727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.997752:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784404740.997759:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728907008:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.997780:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.997795:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728907520:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.997815:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.997829:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728908032:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.997847:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.997914:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907136 00000100:00100000:3.0:1784404740.997921:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907136 00000100:00100000:3.0:1784404740.997957:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784404740.997964:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728907136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998012:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728907136:12345-0@lo:400:kworker.0 Request processed in 48us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404740.998019:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784404740.998410:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728906880:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.998469:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728907392:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.998517:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728907904:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.998555:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784404740.998561:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728907264:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.998590:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728907776:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404740.998634:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907904 00000100:00100000:3.0:1784404740.998639:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907904 00000100:00100000:3.0:1784404740.998665:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907776 00000100:00100000:3.0:1784404740.998667:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907776 00000100:00100000:3.0:1784404740.998683:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784404740.998689:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998724:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728907904:12345-0@lo:400:kworker.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404740.998731:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784404740.998743:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404740.998749:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728907776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998773:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728907776:12345-0@lo:400:kworker.0 Request processed in 25us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404740.998778:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404740.998792:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907392 00000100:00100000:3.0:1784404740.998795:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907392 00000100:00100000:3.0:1784404740.998809:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784404740.998814:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728907392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998842:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728907392:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404740.998888:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:3.0:1784404740.998921:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea3800 x1871083728907776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404740.998934:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728907776:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998944:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728907392:0@lo:400:kworker.0 00010000:00080000:3.0:1784404740.998952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea3480 x1871083728907904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404740.998958:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728907904:0@lo:400:kworker.0 00000100:00100000:3.0:1784404740.998988:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728907136:0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999175:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907648 00000100:00100000:1.0:1784404740.999180:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907648 00000100:00100000:1.0:1784404740.999204:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908160 00000100:00100000:1.0:1784404740.999209:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908160 00000100:00100000:1.0:1784404740.999223:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907008 00000100:00100000:1.0:1784404740.999226:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907008 00000100:00100000:1.0:1784404740.999235:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907520 00000100:00100000:1.0:1784404740.999238:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907520 00000100:00100000:1.0:1784404740.999261:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908032 00000100:00100000:1.0:1784404740.999264:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908032 00000100:00100000:1.0:1784404740.999275:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728907264 00000100:00100000:1.0:1784404740.999278:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728907264 00000100:00100000:1.0:1784404740.999289:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784404740.999295:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728907648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999363:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728907648:12345-0@lo:400:kworker.0 Request processed in 68us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404740.999370:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784404740.999385:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784404740.999390:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728908160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999418:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728908160:12345-0@lo:400:kworker.0 Request processed in 28us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404740.999423:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784404740.999433:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784404740.999438:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728907008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999464:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728907008:12345-0@lo:400:kworker.0 Request processed in 26us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404740.999470:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784404740.999480:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784404740.999486:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728907520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999512:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728907520:12345-0@lo:400:kworker.0 Request processed in 27us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404740.999517:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784404740.999528:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784404740.999534:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728908032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999572:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728908032:12345-0@lo:400:kworker.0 Request processed in 38us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404740.999577:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784404740.999589:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784404740.999594:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728907264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999626:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728907264:12345-0@lo:400:kworker.0 Request processed in 32us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404740.999632:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784404740.999676:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728907008:0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999686:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728907520:0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999694:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728908032:0@lo:400:kworker.0 00010000:00080000:1.0:1784404740.999704:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea0700 x1871083728907648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404740.999714:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728907648:0@lo:400:kworker.0 00010000:00080000:1.0:1784404740.999722:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442454700 x1871083728908160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404740.999729:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728908160:0@lo:400:kworker.0 00000100:00100000:1.0:1784404740.999760:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728907264:0@lo:400:kworker.0 00000100:00100000:2.0:1784404740.999983:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728908288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404741.000018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404741.000482:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728906880 00000100:00100000:0.0:1784404741.000488:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728906880 00000100:00100000:0.0:1784404741.000530:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1784404741.000538:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728906880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404741.000578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728906880:12345-0@lo:400:kworker.0 Request processed in 41us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404741.000584:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1784404741.000623:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908288 00000100:00100000:0.0:1784404741.000627:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908288 00000100:00100000:0.0:1784404741.000653:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784404741.000659:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728908288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784404741.000679:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404741.000713:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728908288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404741.000719:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1784404741.000733:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404741.000737:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404741.000739:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404741.000742:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784404741.000771:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e6d500 x1871083728908288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404741.000787:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728908288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404741.001550:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728908416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404741.001593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404741.001637:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728906880:0@lo:400:kworker.0 00000100:00100000:1.0:1784404741.001803:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908416 00000100:00100000:1.0:1784404741.001809:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908416 00000100:00100000:1.0:1784404741.001879:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784404741.001888:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728908416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784404741.001918:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404741.001954:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728908416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404741.001960:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1784404741.002119:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57ca1aa00 x1871083728908416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404741.002134:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728908416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784404741.379079:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404742.403033:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404742.532794:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404742.532818:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728908544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404742.532929:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404742.533405:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908544 00000100:00100000:0.0:1784404742.533415:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908544 00000100:00100000:0.0:1784404742.533481:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784404742.533491:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728908544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404742.533525:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404742.533597:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728908544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404742.533605:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784404742.533803:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728908544:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784404743.172104:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784404743.172729:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784404743.376007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404743.376044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404743.376070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404743.376093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404743.376251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404743.376293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404743.376322:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707855360 00000100:00100000:0.0:1784404743.376331:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707855360 00000100:00100000:0.0:1784404743.376390:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707855616 00000100:00100000:0.0:1784404743.376393:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707855616 00000100:00100000:0.0:1784404743.376405:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707855232 00000100:00100000:0.0:1784404743.376408:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707855232 00000100:00100000:0.0:1784404743.376419:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707855744 00000100:00100000:0.0:1784404743.376421:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707855744 00000100:00100000:0.0:1784404743.376437:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 224 00000100:00100000:0.0:1784404743.376446:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707855360:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404743.376518:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707855360:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 72us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404743.376536:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 224 00000100:00100000:0.0:1784404743.376555:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 225 00000100:00100000:0.0:1784404743.376561:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707855616:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404743.376698:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 226 00000100:00100000:3.0:1784404743.376707:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707855232:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404743.376811:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707855232:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 105us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404743.376818:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 226 00000100:00100000:3.0:1784404743.376835:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 227 00000100:00100000:3.0:1784404743.376841:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707855744:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404743.376891:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707855744:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 50us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404743.376897:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 227 00000100:00100000:2.0:1784404743.376975:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707855104 00000100:00100000:2.0:1784404743.376979:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707855104 00000100:00100000:2.0:1784404743.377016:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 366 00000100:00100000:2.0:1784404743.377023:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707855104:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404743.377051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707855104:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404743.377057:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 366 00000100:00100000:0.0:1784404743.377272:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707855616:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404743.377292:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 225 00000100:00100000:0.0:1784404743.377321:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707855488 00000100:00100000:0.0:1784404743.377325:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707855488 00000100:00100000:0.0:1784404743.377365:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:0.0:1784404743.377373:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707855488:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404743.377404:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707855488:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 32us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404743.377410:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00080000:0.0:1784404743.377432:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404743.377437:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404743.377438:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784404743.438607:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404743.568887:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728908672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404743.568962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404743.574824:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908672 00000100:00100000:0.0:1784404743.574841:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908672 00000100:00100000:0.0:1784404743.574922:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784404743.574933:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728908672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404743.574975:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784404743.575063:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728908672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (6101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404743.575077:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784404743.575155:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728908672:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784404744.451082:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404745.475059:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404746.115369:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784404746.115398:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728908800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404746.115464:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404746.115477:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728908928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404746.115485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404746.115585:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908800 00000100:00100000:0.0:1784404746.115593:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908800 00000100:00100000:0.0:1784404746.115648:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784404746.115660:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728908800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404746.115689:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1784404746.115784:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784404746.115916:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728909184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404746.120295:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728909440:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.120961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.121028:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728909952:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.121245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.121284:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728910464:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.121307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.121400:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784404746.121407:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728909312:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.121437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.121461:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728909824:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.121485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.121505:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728910336:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.121528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.121575:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909440 00000100:00100000:1.0:1784404746.121583:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909440 00000100:00100000:1.0:1784404746.121627:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909952 00000100:00100000:1.0:1784404746.121630:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909952 00000100:00100000:1.0:1784404746.121665:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910464 00000100:00100000:1.0:1784404746.121668:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910464 00000100:00100000:1.0:1784404746.121704:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1784404746.121712:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728909440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.121933:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728909440:12345-0@lo:400:kworker.0 Request processed in 221us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.121940:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1784404746.121956:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784404746.121961:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728909952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.121985:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728909952:12345-0@lo:400:kworker.0 Request processed in 24us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.121991:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784404746.122012:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784404746.122017:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728910464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.122116:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728910464:12345-0@lo:400:kworker.0 Request processed in 98us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.122123:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784404746.122213:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909312 00000100:00100000:1.0:1784404746.122218:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909312 00000100:00100000:1.0:1784404746.122249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1784404746.122267:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728909312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.122298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728909312:12345-0@lo:400:kworker.0 Request processed in 44us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.122304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1784404746.122504:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909824 00000100:00100000:1.0:1784404746.122508:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909824 00000100:00100000:1.0:1784404746.122535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784404746.122540:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728909824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.122579:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728909824:12345-0@lo:400:kworker.0 Request processed in 39us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.122585:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784404746.122603:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910336 00000100:00100000:1.0:1784404746.122607:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910336 00000100:00100000:1.0:1784404746.122635:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784404746.122642:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728910336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.122672:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728910336:12345-0@lo:400:kworker.0 Request processed in 31us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.122679:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784404746.122726:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728909312:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123081:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728909824:0@lo:400:kworker.0 00010000:00080000:1.0:1784404746.123095:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea3800 x1871083728910336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404746.123104:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728910336:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123115:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728909440:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123124:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728909952:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123133:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728910464:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123210:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728909056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404746.123245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.123280:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728909568:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123302:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.123557:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728910080:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.123602:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728910592:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123620:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784404746.123649:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404746.123654:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404746.123664:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910080 00000100:00100000:1.0:1784404746.123668:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910080 00000100:00100000:1.0:1784404746.123707:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910592 00000100:00100000:1.0:1784404746.123710:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910592 00000100:00100000:1.0:1784404746.123742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784404746.123750:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728910080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123789:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728910080:12345-0@lo:400:kworker.0 Request processed in 40us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.123796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784404746.123810:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784404746.123816:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728910592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123842:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728910592:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.123847:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:1.0:1784404746.123889:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404746.123897:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909568 00000100:00100000:1.0:1784404746.123900:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909568 00000100:00100000:1.0:1784404746.123921:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784404746.123928:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728909568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.123958:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728909568:12345-0@lo:400:kworker.0 Request processed in 32us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.123976:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784404746.124006:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728909568:0@lo:400:kworker.0 00010000:00080000:1.0:1784404746.124015:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea3480 x1871083728910080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404746.124024:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728910080:0@lo:400:kworker.0 00010000:00080000:1.0:1784404746.124655:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541664a80 x1871083728910592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404746.124666:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728910592:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.124717:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909056 00000100:00100000:1.0:1784404746.124721:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909056 00000100:00100000:1.0:1784404746.124817:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784404746.124824:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728909056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404746.124841:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404746.124912:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728909056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.124919:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1784404746.124938:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404746.124965:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728909056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404746.126584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404746.127167:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728908928 00000100:00100000:1.0:1784404746.127176:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728908928 00000100:00100000:1.0:1784404746.127227:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784404746.127236:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728908928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784404746.127276:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404746.127339:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728908928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.127353:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:2.0:1784404746.127962:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348fb80 x1871083728908928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404746.127983:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728908928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404746.131251:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728908800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15586us (15758us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404746.131274:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784404746.131455:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728908800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404746.136331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404746.136435:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728909696:0@lo:400:kworker.0 00000100:00100000:3.0:1784404746.136490:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404746.136516:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728910208:0@lo:400:kworker.0 00000100:00100000:3.0:1784404746.136539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404746.136566:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728910720:0@lo:400:kworker.0 00000100:00100000:3.0:1784404746.136584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404746.136624:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910208 00000100:00100000:3.0:1784404746.136631:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910208 00000100:00100000:2.0:1784404746.136632:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910720 00000100:00100000:2.0:1784404746.136639:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910720 00000100:00100000:0.0:1784404746.136713:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909696 00000100:00100000:0.0:1784404746.136717:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909696 00000100:00100000:0.0:1784404746.136746:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784404746.136754:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728909696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404746.136799:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728909696:12345-0@lo:400:kworker.0 Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404746.136806:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784404746.138083:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784404746.138102:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728910208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404746.138164:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728910208:12345-0@lo:400:kworker.0 Request processed in 70us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404746.138171:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784404746.138190:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784404746.138197:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728910720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404746.138225:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728910720:12345-0@lo:400:kworker.0 Request processed in 30us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404746.138247:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1784404746.140223:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404746.140293:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728910720:0@lo:400:kworker.0 00000100:00100000:2.0:1784404746.140331:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728909696:0@lo:400:kworker.0 00010000:00080000:2.0:1784404746.140346:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea1500 x1871083728910208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404746.140358:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728910208:0@lo:400:kworker.0 00000100:00100000:1.0:1784404746.141179:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728909184 00000100:00100000:1.0:1784404746.141187:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728909184 00000100:00100000:1.0:1784404746.141246:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784404746.141266:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728909184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404746.141292:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404746.141365:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728909184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404746.141372:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1784404746.141663:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442454700 x1871083728909184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404746.141683:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728909184:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784404746.499731:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404747.524612:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404747.651524:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728910848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404747.651595:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404747.651898:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910848 00000100:00100000:2.0:1784404747.651907:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910848 00000100:00100000:2.0:1784404747.651958:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784404747.651968:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728910848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404747.652010:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404747.652068:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728910848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404747.652075:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784404747.652353:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728910848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404748.495057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404748.495110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404748.495219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404748.495317:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707855872 00000100:00100000:0.0:1784404748.495330:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707855872 00000100:00100000:0.0:1784404748.495392:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 368 00000100:00100000:0.0:1784404748.495402:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707855872:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404748.495475:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707855872:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 73us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404748.495483:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 368 00000100:00100000:1.0:1784404748.503952:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856128 00000100:00100000:1.0:1784404748.503969:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856128 00000100:00100000:1.0:1784404748.504118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 234 00000100:00100000:1.0:1784404748.504131:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707856128:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404748.504213:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707856128:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 86us (9103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404748.504221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 234 00000100:00100000:1.0:1784404748.504249:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856000 00000100:00100000:1.0:1784404748.504254:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856000 00000100:00080000:2.0:1784404748.504656:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404748.504662:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404748.504906:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 235 00000100:00100000:1.0:1784404748.504916:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707856000:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404748.504962:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707856000:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 49us (9743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404748.504970:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 235 00000100:00100000:3.0:1784404748.509061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404748.509103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404748.509134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404748.509278:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856384 00000100:00100000:0.0:1784404748.509288:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856384 00000100:00100000:0.0:1784404748.509359:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856512 00000100:00100000:0.0:1784404748.509363:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856512 00000100:00100000:0.0:1784404748.509387:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 236 00000100:00100000:0.0:1784404748.509397:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707856384:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404748.509470:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707856384:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 75us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404748.509479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 236 00000100:00100000:0.0:1784404748.509497:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 237 00000100:00100000:0.0:1784404748.509504:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707856512:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404748.509528:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707856512:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404748.509534:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 237 00000100:00080000:3.0:1784404748.509722:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404748.509727:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404748.509934:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856256 00000100:00100000:2.0:1784404748.509939:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856256 00000100:00100000:2.0:1784404748.509990:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1784404748.510008:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2400:x1871083707856256:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:2.0:1784404748.510029:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78f79 00000100:00080000:2.0:1784404748.510039:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9dd574f21000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404748.510089:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1784404748.510223:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+2:2400:x1871083707856256:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 225us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404748.510253:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00010000:00010000:0.0:1784404748.510482:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784404748.510762:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784404748.547148:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404748.675382:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728910976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404748.675471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404748.676773:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728910976 00000100:00100000:3.0:1784404748.676785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728910976 00000100:00100000:3.0:1784404748.676903:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784404748.676916:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728910976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404748.677109:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784404748.677204:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728910976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 291us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404748.677212:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784404748.677346:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728910976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784404749.571057:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404750.595126:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404751.235565:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728911360:0@lo:400:kworker.0 00000100:00100000:0.0:1784404751.235686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404751.235908:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728911104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404751.235940:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404751.235974:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404751.235982:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728911232:0@lo:400:kworker.0 00000100:00100000:1.0:1784404751.236010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404751.236043:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728911360 00000100:00100000:1.0:1784404751.236051:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728911360 00000100:00100000:1.0:1784404751.236093:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1784404751.236100:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728911360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404751.236262:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728911744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404751.236288:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404751.236307:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404751.236312:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728911616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404751.236333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404751.236356:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728911104 00000100:00100000:2.0:1784404751.236359:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728911104 00000100:00100000:2.0:1784404751.236385:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728911744 00000100:00100000:2.0:1784404751.236388:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728911744 00000100:00100000:2.0:1784404751.236398:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728911616 00000100:00100000:2.0:1784404751.236401:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728911616 00000100:00100000:2.0:1784404751.236416:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784404751.236422:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728911104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404751.236443:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404751.236473:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728911104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404751.236479:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784404751.236495:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784404751.236501:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728911744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404751.236513:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404751.236540:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728911744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404751.236546:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784404751.236566:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784404751.236572:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728911616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404751.236581:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404751.236604:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728911616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404751.236610:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1784404751.236641:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541327480 x1871083728911616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404751.236658:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728911616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404751.236670:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728911744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404751.236700:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728911488:0@lo:400:kworker.0 00000100:00100000:2.0:1784404751.236725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784404751.236755:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404751.236758:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404751.236770:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728911488 00000100:00100000:2.0:1784404751.236774:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728911488 00000100:00100000:2.0:1784404751.236799:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784404751.236805:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728911488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404751.236839:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728911488:12345-0@lo:400:kworker.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404751.236845:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784404751.236887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728911488:0@lo:400:kworker.0 00000100:00100000:2.0:1784404751.236915:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728911232 00000100:00100000:2.0:1784404751.236918:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728911232 00000100:00100000:2.0:1784404751.236942:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1784404751.236948:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728911232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404751.236984:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728911232:12345-0@lo:400:kworker.0 Request processed in 36us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404751.236991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1784404751.238380:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728911872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404751.238971:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728912000:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.239447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404751.239552:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728912512:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.239592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404751.239650:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404751.239656:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728912384:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.239685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404751.239754:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728912256:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.240143:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404751.240157:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728912768:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.240183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404751.240205:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784404751.240224:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728912128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.240249:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404751.240279:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728912640:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.240302:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404751.240334:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912768 00000100:00100000:3.0:1784404751.240342:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912768 00000100:00100000:3.0:1784404751.240425:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784404751.240439:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728912768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.240516:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728912768:12345-0@lo:400:kworker.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404751.240524:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1784404751.240559:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784404751.240572:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912128 00000100:00100000:3.0:1784404751.240578:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912128 00000100:00100000:3.0:1784404751.241139:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784404751.241154:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728912128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.241246:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728912128:12345-0@lo:400:kworker.0 Request processed in 97us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404751.241256:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784404751.241326:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728912128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.241347:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728912768:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.241442:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728911232:0@lo:400:kworker.0 00010000:00080000:3.0:1784404751.241463:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c61500 x1871083728911104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404751.243031:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728911104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404751.243101:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912000 00000100:00100000:3.0:1784404751.243111:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912000 00000100:00100000:3.0:1784404751.243155:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912512 00000100:00100000:3.0:1784404751.243159:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912512 00000100:00100000:3.0:1784404751.243194:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912384 00000100:00100000:3.0:1784404751.243200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912384 00000100:00100000:3.0:1784404751.243234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912256 00000100:00100000:3.0:1784404751.243239:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912256 00000100:00100000:3.0:1784404751.243264:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912640 00000100:00100000:3.0:1784404751.243269:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912640 00000100:00100000:3.0:1784404751.243294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784404751.243304:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728912000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.243402:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728912000:12345-0@lo:400:kworker.0 Request processed in 97us (3981us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404751.243410:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784404751.243433:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1784404751.243468:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728912512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404751.244185:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728911360:12345-0@lo:400:kworker.0 Request processed in 8081us (8497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404751.244194:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1784404751.244241:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1784404751.244252:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728912384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404751.244292:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728912384:12345-0@lo:400:kworker.0 Request processed in 44us (4609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404751.244298:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1784404751.244315:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1784404751.244320:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728912256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404751.244358:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728912256:12345-0@lo:400:kworker.0 Request processed in 38us (4216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404751.244365:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1784404751.244377:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784404751.244383:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728912640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404751.244434:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728912640:12345-0@lo:400:kworker.0 Request processed in 51us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404751.244440:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:1.0:1784404751.244496:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541664a80 x1871083728912640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404751.244512:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728912640:0@lo:400:kworker.0 00000100:00100000:1.0:1784404751.244527:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728912256:0@lo:400:kworker.0 00000100:00080000:1.0:1784404751.244597:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404751.244602:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784404751.244626:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541666680 x1871083728912384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404751.244636:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728912384:0@lo:400:kworker.0 00000100:00100000:1.0:1784404751.244648:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728912000:0@lo:400:kworker.0 00000100:00100000:3.0:1784404751.248149:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728912512:12345-0@lo:400:kworker.0 Request processed in 4700us (8548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404751.248162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784404751.248307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404751.248369:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728911360:0@lo:400:kworker.0 00000100:00100000:2.0:1784404751.248458:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728911872 00000100:00100000:2.0:1784404751.248465:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728911872 00000100:00100000:2.0:1784404751.248520:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784404751.248535:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728911872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404751.248557:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404751.248635:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728911872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404751.248641:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784404751.248788:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728911872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404751.250077:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728912512:0@lo:400:kworker.0 00010000:00010000:0.0:1784404751.619760:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404752.643525:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404752.781550:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784404752.781576:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728912896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404752.781661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404752.782145:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728912896 00000100:00100000:2.0:1784404752.782154:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728912896 00000100:00100000:2.0:1784404752.782222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784404752.782233:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728912896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404752.782269:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404752.782328:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728912896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404752.782336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784404752.782475:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728912896:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784404753.411800:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784404753.424651:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784404753.618331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404753.618374:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404753.618396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404753.618412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404753.618435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404753.618548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856640 00000100:00100000:2.0:1784404753.618559:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856640 00000100:00100000:2.0:1784404753.618616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 370 00000100:00100000:2.0:1784404753.618625:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707856640:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404753.618691:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707856640:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 67us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404753.618698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 370 00000100:00100000:2.0:1784404753.618729:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856896 00000100:00100000:2.0:1784404753.618732:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856896 00000100:00100000:2.0:1784404753.618765:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857152 00000100:00100000:2.0:1784404753.618767:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857152 00000100:00100000:2.0:1784404753.618779:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707856768 00000100:00100000:2.0:1784404753.618781:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707856768 00000100:00100000:2.0:1784404753.618792:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857024 00000100:00100000:2.0:1784404753.618794:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857024 00000100:00100000:2.0:1784404753.618806:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 244 00000100:00100000:2.0:1784404753.618812:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707856896:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404753.618840:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707856896:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404753.618847:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 244 00000100:00100000:2.0:1784404753.618883:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:2.0:1784404753.618890:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707857152:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404753.618916:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707857152:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404753.618922:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:2.0:1784404753.618934:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:2.0:1784404753.618940:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707856768:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404753.618961:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707856768:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404753.618975:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:2.0:1784404753.618987:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 247 00000100:00100000:2.0:1784404753.618993:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707857024:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404753.619036:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707857024:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 42us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404753.619042:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 247 00000100:00080000:2.0:1784404753.619298:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404753.619303:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784404753.667599:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404753.795228:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404753.795251:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728913024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404753.795314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404753.795381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913024 00000100:00100000:2.0:1784404753.795390:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913024 00000100:00100000:2.0:1784404753.795437:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784404753.795447:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728913024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404753.795482:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784404753.795530:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728913024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404753.795538:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784404753.795585:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728913024:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1784404754.312147:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:3.0:1784404754.312155:0:9511:0:(genops.c:885:class_export_put()) final put ffff9dd574f24800/1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:3.0:1784404754.318636:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574f24800/1827e730-172d-4769-8ecb-95f4e65fc8a0 for lustre-OST0001 00000020:00000080:3.0:1784404754.318728:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574f21000 for lustre-OST0001 00010000:00010000:0.0:1784404754.691448:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404755.721027:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404756.355021:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728913280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404756.355098:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404756.355158:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404756.355178:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728913152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404756.355209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404756.355247:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913280 00000100:00100000:3.0:1784404756.355254:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913280 00000100:00100000:3.0:1784404756.355316:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913152 00000100:00100000:3.0:1784404756.355320:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913152 00000100:00100000:3.0:1784404756.355337:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784404756.355346:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728913280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404756.355376:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404756.355420:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728913280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404756.355427:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784404756.355443:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784404756.355449:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728913152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404756.355464:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404756.355499:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728913152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404756.355504:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1784404756.355533:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784404756.355538:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784404756.355567:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574e33480 x1871083728913152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404756.355586:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728913152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404756.355598:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728913280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404756.356293:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728913536:0@lo:400:kworker.0 00000100:00100000:3.0:1784404756.356553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404756.356581:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404756.356587:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728913408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404756.356617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404756.356655:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913408 00000100:00100000:3.0:1784404756.356661:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913408 00000100:00100000:3.0:1784404756.356692:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1784404756.356700:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728913408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404756.356739:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728913408:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404756.356746:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1784404756.356798:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728913408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404756.356816:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728913664:0@lo:400:kworker.0 00000100:00100000:3.0:1784404756.356841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404756.359459:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728914048:0@lo:400:kworker.0 00000100:00100000:3.0:1784404756.359527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404756.359566:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728914560:0@lo:400:kworker.0 00000100:00100000:3.0:1784404756.359601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.359742:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728913792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404756.360148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.360189:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728914304:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.360214:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.360239:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728914816:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.360264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.360284:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784404756.360290:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728914176:0@lo:400:kworker.0 00000100:00100000:1.0:1784404756.360390:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728913920:0@lo:400:kworker.0 00000100:00100000:1.0:1784404756.360419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404756.360437:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728914432:0@lo:400:kworker.0 00000100:00100000:1.0:1784404756.360456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.360949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.360972:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728914688:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.360996:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.361020:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913536 00000100:00100000:2.0:1784404756.361028:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913536 00000100:00100000:1.0:1784404756.361163:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914816 00000100:00100000:1.0:1784404756.361181:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914816 00000100:00100000:1.0:1784404756.361219:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914432 00000100:00100000:1.0:1784404756.361222:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914432 00000100:00100000:1.0:1784404756.361244:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784404756.361252:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728914816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.361627:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914560 00000100:00100000:2.0:1784404756.361633:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914560 00000100:00100000:2.0:1784404756.361656:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914304 00000100:00100000:2.0:1784404756.361658:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914304 00000100:00100000:2.0:1784404756.361671:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913920 00000100:00100000:2.0:1784404756.361673:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913920 00000100:00100000:2.0:1784404756.361684:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914176 00000100:00100000:2.0:1784404756.361686:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914176 00000100:00100000:2.0:1784404756.361699:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914688 00000100:00100000:2.0:1784404756.361701:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914688 00000100:00100000:2.0:1784404756.361713:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1784404756.361720:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728913536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.361806:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728913536:12345-0@lo:400:kworker.0 Request processed in 85us (5252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.361814:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1784404756.361837:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1784404756.361845:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728914560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.361904:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728914560:12345-0@lo:400:kworker.0 Request processed in 61us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.361911:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1784404756.361933:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784404756.361939:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728914304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.361968:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728914304:12345-0@lo:400:kworker.0 Request processed in 30us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.361975:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784404756.361991:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1784404756.361997:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728913920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362034:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728913920:12345-0@lo:400:kworker.0 Request processed in 37us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362040:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1784404756.362052:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784404756.362058:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728914176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362094:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728914176:12345-0@lo:400:kworker.0 Request processed in 37us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362099:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784404756.362109:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784404756.362114:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728914688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362134:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728914688:12345-0@lo:400:kworker.0 Request processed in 21us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362139:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784404756.362162:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913664 00000100:00100000:2.0:1784404756.362176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913664 00000100:00100000:2.0:1784404756.362193:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914048 00000100:00100000:2.0:1784404756.362195:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914048 00000100:00100000:2.0:1784404756.362205:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784404756.362210:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728913664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362258:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728913664:12345-0@lo:400:kworker.0 Request processed in 47us (5416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362264:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784404756.362275:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784404756.362280:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362314:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728914048:12345-0@lo:400:kworker.0 Request processed in 33us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362320:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784404756.362353:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728913792 00000100:00100000:2.0:1784404756.362356:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728913792 00000100:00100000:2.0:1784404756.362387:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784404756.362394:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728913792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404756.362409:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404756.362440:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728913792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362447:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784404756.362471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404756.362478:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728914432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362517:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728914432:12345-0@lo:400:kworker.0 Request processed in 41us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362524:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404756.362573:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728914560:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362585:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728914048:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362596:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728913536:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362626:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404756.362634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728914944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404756.362663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404756.362691:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728914944 00000100:00100000:2.0:1784404756.362695:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728914944 00000100:00100000:2.0:1784404756.362713:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784404756.362719:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728914944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404756.362728:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404756.362754:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728914944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404756.362759:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784404756.362787:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728914944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404756.362807:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728914176:0@lo:400:kworker.0 00010000:00080000:2.0:1784404756.362822:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea3480 x1871083728914688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404756.362833:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728914688:0@lo:400:kworker.0 00010000:00080000:2.0:1784404756.362846:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd4410b2a00 x1871083728913792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404756.362876:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728913792:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1784404756.362890:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd442457100 x1871083728914304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404756.362898:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728914304:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362907:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728914816:0@lo:400:kworker.0 00000100:00100000:2.0:1784404756.362950:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728913920:0@lo:400:kworker.0 00010000:00080000:2.0:1784404756.362961:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574ea1500 x1871083728914432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404756.362969:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728914432:0@lo:400:kworker.0 00000100:00080000:0.0:1784404756.364424:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404756.364434:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404756.364436:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404756.364440:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784404756.364557:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728913664:0@lo:400:kworker.0 00000100:00100000:1.0:1784404756.370885:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728914816:12345-0@lo:400:kworker.0 Request processed in 9621us (10606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404756.370902:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1784404756.740600:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404757.763108:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404757.891672:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404757.891698:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728915072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404757.891780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404757.893264:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915072 00000100:00100000:2.0:1784404757.893280:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915072 00000100:00100000:2.0:1784404757.893353:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784404757.893366:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728915072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404757.893409:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404757.893502:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728915072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404757.893510:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784404757.894367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728915072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404758.744465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404758.744517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404758.744547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404758.744597:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857280 00000100:00100000:0.0:1784404758.744613:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857280 00000100:00100000:0.0:1784404758.744672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 372 00000100:00100000:0.0:1784404758.744684:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707857280:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404758.744767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707857280:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 85us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404758.744774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 372 00000100:00100000:3.0:1784404758.751219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404758.760012:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857792 00000100:00100000:2.0:1784404758.760028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857792 00000100:00100000:3.0:1784404758.760082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404758.760099:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857408 00000100:00100000:2.0:1784404758.760104:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857408 00000100:00100000:2.0:1784404758.760123:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857664 00000100:00100000:2.0:1784404758.760126:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857664 00000100:00100000:2.0:1784404758.760158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 254 00000100:00100000:2.0:1784404758.760169:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707857792:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404758.760264:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857536 00000100:00100000:1.0:1784404758.760268:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857536 00000100:00100000:2.0:1784404758.760358:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707857792:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 190us (15810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404758.760366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 254 00000100:00100000:0.0:1784404758.760438:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 255 00000100:00100000:0.0:1784404758.760448:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707857408:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404758.760484:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707857408:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (9279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404758.760501:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 255 00000100:00100000:0.0:1784404758.760519:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 256 00000100:00100000:0.0:1784404758.760525:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707857664:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404758.760566:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707857664:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404758.760573:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 256 00000100:00100000:0.0:1784404758.760586:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 257 00000100:00100000:0.0:1784404758.760594:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707857536:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404758.760617:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707857536:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (16099us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404758.760623:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 257 00000100:00080000:2.0:1784404758.760766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404758.760771:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784404758.793424:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404758.915837:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404758.915900:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728915200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404758.915970:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404758.916034:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915200 00000100:00100000:2.0:1784404758.916041:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915200 00000100:00100000:2.0:1784404758.916097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784404758.916105:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728915200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404758.916137:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784404758.916193:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728915200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404758.916201:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784404758.916246:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728915200:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1784404759.091843:0:14056:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:59:18 (1784404758) 00010000:00010000:0.0:1784404759.811054:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404760.716406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404760.716574:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707857920 00000100:00100000:0.0:1784404760.716585:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707857920 00000100:00100000:0.0:1784404760.716675:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1784404760.716687:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:11075:x1871083707857920:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784404760.716707:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404760.716731:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71ab expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404760.716797:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79060 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404760.716823:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404760.716894:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404760.716945:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784404760.716949:0:13543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404760.716986:0:13543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404760.717012:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ab expref: 7 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404760.717031:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79060 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ab expref: 6 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404760.717039:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd57067d100) 00010000:00010000:0.0:1784404760.717042:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404760.717046:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a000, rc 0) 00000100:00100000:0.0:1784404760.717118:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:11075:x1871083707857920:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 434us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404760.717125:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00080000:3.0:1784404760.717596:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404760.741376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404760.741499:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707858048 00000100:00100000:2.0:1784404760.741512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707858048 00000100:00100000:2.0:1784404760.741584:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:2.0:1784404760.741597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:11076:x1871083707858048:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404760.741618:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404760.741641:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71b2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742056:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742086:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742114:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742165:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742184:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742191:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742283:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391000/0x24b3e2e6dcd7907c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742302:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391000/0x24b3e2e6dcd7907c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742311:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391000/0x24b3e2e6dcd7907c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404760.742372:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784404760.742376:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404760.742406:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391000/0x24b3e2e6dcd7907c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742426:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742434:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742441:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742464:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404760.742468:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742486:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742499:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd57067d100) 00010000:00010000:2.0:1784404760.742502:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404760.742513:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742520:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd7906e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742546:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742552:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742559:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742564:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404760.742575:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742581:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742607:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dd443413500) 00010000:00010000:2.0:1784404760.742610:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404760.742613:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742619:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79075 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742668:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71b2 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742682:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391000/0x24b3e2e6dcd7907c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71b2 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.742697:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd443413d00) 00010000:00010000:2.0:1784404760.742700:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784404760.742703:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391000, rc 0) 00000100:00100000:2.0:1784404760.743077:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:11076:x1871083707858048:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1481us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404760.743085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:0.0:1784404760.755220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404760.755317:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707858176 00000100:00100000:1.0:1784404760.755328:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707858176 00000100:00100000:1.0:1784404760.755390:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1784404760.755403:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:11076:x1871083707858176:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784404760.755501:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:11076:x1871083707858176:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404760.755510:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:3.0:1784404760.763450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404760.763553:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707858432 00000100:00100000:2.0:1784404760.763565:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707858432 00000100:00100000:2.0:1784404760.763617:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:2.0:1784404760.763626:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:11076:x1871083707858432:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404760.763647:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404760.763670:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd79083 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71b9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.763767:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.763782:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.763794:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.763885:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.763893:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.763901:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764010:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391600/0x24b3e2e6dcd79098 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764020:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391600/0x24b3e2e6dcd79098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764038:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391600/0x24b3e2e6dcd79098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404760.764048:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784404760.764146:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764154:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764165:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764171:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404760.764175:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764182:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764193:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd443413d00) 00010000:00010000:2.0:1784404760.764196:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404760.764199:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764205:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd7908a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764218:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764224:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764230:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764235:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404760.764238:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764253:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764262:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd443413500) 00010000:00010000:2.0:1784404760.764264:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404760.764266:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764272:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79091 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764538:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd79083 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71b9 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764552:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391600/0x24b3e2e6dcd79098 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71b9 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404760.764558:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:2.0:1784404760.764560:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404760.764562:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd541391600, rc 0) 00000100:00100000:2.0:1784404760.764633:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:11076:x1871083707858432:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1007us (1192us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784404760.764641:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:0.0:1784404760.775901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404760.776103:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707858560 00000100:00100000:1.0:1784404760.776115:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707858560 00000100:00100000:1.0:1784404760.776194:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:1.0:1784404760.776207:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:11076:x1871083707858560:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784404760.776561:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:11076:x1871083707858560:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 355us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404760.776569:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:2.0:1784404760.780382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404760.780473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707858688 00000100:00100000:0.0:1784404760.780483:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707858688 00000100:00100000:0.0:1784404760.780550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1784404760.780560:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:11076:x1871083707858688:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1784404760.784400:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3798us 00000100:00080000:3.0:1784404760.784766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404760.810261:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:11076:x1871083707858688:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 29691us (29877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404760.810281:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00010000:00010000:0.0:1784404760.836048:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404761.483050:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784404761.483073:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728915456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404761.483151:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.483172:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728915968:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483198:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728915328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404761.483202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404761.483217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.483233:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728916480:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483235:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728915840:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.483256:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404761.483256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.483271:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728916992:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483271:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728916352:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404761.483306:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728916864:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.483307:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404761.483326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.483339:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728915584:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483355:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915968 00000100:00100000:1.0:1784404761.483361:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915968 00000100:00100000:2.0:1784404761.483368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.483387:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728916096:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483399:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916352 00000100:00100000:1.0:1784404761.483402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916352 00000100:00100000:2.0:1784404761.483406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.483420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728916608:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483427:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916864 00000100:00100000:1.0:1784404761.483429:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916864 00000100:00100000:2.0:1784404761.483438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404761.483446:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784404761.483452:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728917120:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483453:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728915968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.483469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.483485:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784404761.483490:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728915712:0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483497:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728915968:12345-0@lo:400:kworker.0 Request processed in 45us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404761.483504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784404761.483520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784404761.483532:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728916352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728916352:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404761.483572:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784404761.483583:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784404761.483589:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728916864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.483615:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728916864:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404761.483621:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:1.0:1784404761.483659:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348fb80 x1871083728916352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404761.483672:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728916352:0@lo:400:kworker.0 00010000:00080000:1.0:1784404761.483682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443768380 x1871083728916864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404761.483690:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728916864:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.484009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.484027:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728916224:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.484049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.484067:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728916736:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.484087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.484115:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915456 00000100:00100000:2.0:1784404761.484130:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915456 00000100:00100000:1.0:1784404761.484194:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915712 00000100:00100000:1.0:1784404761.484198:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915712 00000100:00100000:1.0:1784404761.484218:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916224 00000100:00100000:1.0:1784404761.484220:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916224 00000100:00100000:1.0:1784404761.484233:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916736 00000100:00100000:1.0:1784404761.484235:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916736 00000100:00100000:1.0:1784404761.484248:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784404761.484253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728915712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.484302:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728915712:12345-0@lo:400:kworker.0 Request processed in 48us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404761.484318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784404761.484331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784404761.484337:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728916224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.484364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728916224:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404761.484369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784404761.484379:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784404761.484385:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728916736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404761.484407:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728916736:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404761.484412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784404761.484600:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915328 00000100:00100000:2.0:1784404761.484605:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915328 00000100:00100000:2.0:1784404761.484622:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784404761.484628:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728915456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404761.484658:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404761.484696:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728915456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404761.484703:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784404761.484715:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784404761.484721:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728915328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404761.484736:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404761.484761:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728915328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404761.484767:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784404761.484794:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916480 00000100:00100000:2.0:1784404761.484797:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916480 00000100:00100000:2.0:1784404761.484816:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916992 00000100:00100000:2.0:1784404761.484818:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916992 00000100:00100000:2.0:1784404761.484829:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916608 00000100:00100000:2.0:1784404761.484832:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916608 00000100:00100000:2.0:1784404761.484840:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728917120 00000100:00100000:2.0:1784404761.484843:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728917120 00000100:00100000:3.0:1784404761.489502:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784404761.489525:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728916480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.489616:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728916480:12345-0@lo:400:kworker.0 Request processed in 103us (6359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.489622:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784404761.489645:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784404761.489651:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728916992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.489678:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728916992:12345-0@lo:400:kworker.0 Request processed in 28us (6371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.489684:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784404761.489695:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784404761.489701:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728916608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.489728:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728916608:12345-0@lo:400:kworker.0 Request processed in 28us (6290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.489733:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1784404761.490043:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784404761.490057:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404761.490060:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404761.490062:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404761.490211:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728917248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404761.490247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404761.490287:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728917248 00000100:00100000:3.0:1784404761.490294:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728917248 00000100:00100000:3.0:1784404761.490325:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784404761.490331:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728917248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404761.490345:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404761.490588:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728917248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 256us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.490594:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1784404761.490631:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541664e00 x1871083728917248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404761.490649:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728917248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404761.496313:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915840 00000100:00100000:3.0:1784404761.496330:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915840 00000100:00100000:3.0:1784404761.496380:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728916096 00000100:00100000:3.0:1784404761.496383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728916096 00000100:00100000:3.0:1784404761.496401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784404761.496410:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728915840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.496512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728915840:12345-0@lo:400:kworker.0 Request processed in 103us (13254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.496519:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784404761.496535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784404761.496541:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728916096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.496580:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728916096:12345-0@lo:400:kworker.0 Request processed in 39us (13172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.496586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784404761.496610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728915584 00000100:00100000:3.0:1784404761.496614:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728915584 00000100:00100000:3.0:1784404761.496642:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1784404761.496648:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728915584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.496677:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728915584:12345-0@lo:400:kworker.0 Request processed in 29us (13307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.496683:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1784404761.497846:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728915968:0@lo:400:kworker.0 00010000:00080000:2.0:1784404761.497893:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44376b100 x1871083728916480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404761.497904:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728916480:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.497916:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728916992:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.497941:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404761.497960:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728917376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404761.498003:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404761.498070:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728915712:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.498081:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728916224:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.498093:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728916736:0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.498095:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728917376 00000100:00100000:3.0:1784404761.498099:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728917376 00000100:00100000:2.0:1784404761.498101:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728915584:0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.498110:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728916096:0@lo:400:kworker.0 00010000:00080000:2.0:1784404761.498133:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443769f80 x1871083728916608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404761.498143:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728916608:0@lo:400:kworker.0 00000100:00100000:3.0:1784404761.498168:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784404761.498176:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728917376:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404761.498184:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd441abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728915840:0@lo:400:kworker.0 00002000:00000024:3.0:1784404761.498199:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404761.498205:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728915456:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784404761.498217:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541324000 x1871083728915328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404761.498229:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728915328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404761.498239:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728917376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404761.498245:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784404761.498255:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44376b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728917376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404761.498298:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784404761.498306:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728917120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404761.498347:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728917120:12345-0@lo:400:kworker.0 Request processed in 43us (14876us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404761.501794:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784404761.501910:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728917120:0@lo:400:kworker.0 00000040:00080000:3.0:1784404761.603805:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784404761.605128:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784404761.859018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404762.883822:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404763.020344:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404763.022463:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728917504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404763.022546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404763.022766:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728917504 00000100:00100000:2.0:1784404763.022782:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728917504 00000100:00100000:2.0:1784404763.022846:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784404763.022881:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728917504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404763.022923:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404763.022978:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728917504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404763.022986:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784404763.023945:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728917504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404763.064434:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404763.066980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707858816 00000100:00100000:3.0:1784404763.066996:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707858816 00000100:00100000:3.0:1784404763.067151:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:3.0:1784404763.067164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:11119:x1871083707858816:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404763.067189:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404763.067219:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd790a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71c0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067292:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067307:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067319:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067333:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067340:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067345:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067394:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067402:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067408:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067415:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404763.067419:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067438:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067451:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd57067d100) 00010000:00010000:3.0:1784404763.067454:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404763.067460:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067467:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd790ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067480:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067486:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067492:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067496:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404763.067500:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067505:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067512:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd544e47a00) 00010000:00010000:3.0:1784404763.067515:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404763.067518:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067533:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd790b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067566:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd790a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71c0 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067577:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd57067d100) 00010000:00010000:3.0:1784404763.067579:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404763.067583:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd790a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71c0 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.067591:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7800, rc 0) 00000100:00100000:3.0:1784404763.067654:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:11119:x1871083707858816:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 493us (3230us total) trans 0 rc 301/301 00000100:00100000:3.0:1784404763.067661:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00080000:0.0:1784404763.076453:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404763.076588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404763.079315:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707859072 00000100:00100000:2.0:1784404763.079329:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707859072 00000100:00100000:2.0:1784404763.079395:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:2.0:1784404763.079406:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:11119:x1871083707859072:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:2.0:1784404763.079465:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404763.079490:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79060 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ab expref: 9 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.079506:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd57067d100) 00010000:00010000:2.0:1784404763.079517:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404763.079595:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.079607:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.079616:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.079626:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.079633:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.079655:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080145:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080154:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080162:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404763.080174:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073752151 reply state 00000000cd1ac7bd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080185:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080192:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404763.080194:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404763.080197:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784404763.080202:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784404763.080208:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080214:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080221:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080227:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404763.080236:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080244:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080252:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:2.0:1784404763.080254:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404763.080257:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080264:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd790bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404763.080279:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073752151 reply state 00000000cd1ac7bd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080286:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.080292:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd443416800) 00010000:00010000:2.0:1784404763.080294:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404763.080295:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784404763.080398:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:11119:x1871083707859072:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 992us (3812us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784404763.080407:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:3.0:1784404763.201410:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404763.201560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707859200 00000100:00100000:2.0:1784404763.201571:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707859200 00000100:00100000:2.0:1784404763.201637:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:2.0:1784404763.201647:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:11127:x1871083707859200:12345-192.168.202.42@tcp:101:lctl.0 00010000:00010000:2.0:1784404763.201676:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404763.201714:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd790d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.201784:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd790d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.201812:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd790d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.201827:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd790d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404763.201914:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784404763.201919:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404763.201959:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd790d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.201987:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd790d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71c7 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.202008:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd790d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71c7 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.202016:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:2.0:1784404763.202019:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784404763.202023:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031600, rc 0) 00000100:00100000:2.0:1784404763.202430:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:11127:x1871083707859200:12345-192.168.202.42@tcp:101:lctl.0 Request processed in 782us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404763.202438:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:2.0:1784404763.295534:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.295650:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707859328 00000100:00100000:1.0:1784404763.295661:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707859328 00000100:00100000:1.0:1784404763.295716:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:1.0:1784404763.295725:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:11133:x1871083707859328:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404763.295744:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404763.295763:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd790de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.295841:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.295899:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.295923:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.295936:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.295944:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.295950:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296203:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549c00/0x24b3e2e6dcd790f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296212:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549c00/0x24b3e2e6dcd790f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296220:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549c00/0x24b3e2e6dcd790f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404763.296255:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784404763.296259:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404763.296296:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549c00/0x24b3e2e6dcd790f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296309:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296315:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296330:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296336:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404763.296340:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296347:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296359:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:1.0:1784404763.296363:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404763.296367:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296374:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd790e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296387:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296393:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296398:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296403:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404763.296406:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296422:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296431:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd443416800) 00010000:00010000:1.0:1784404763.296433:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404763.296436:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296441:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd790ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296466:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd790de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ce expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296479:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549c00/0x24b3e2e6dcd790f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ce expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.296485:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404763.296487:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784404763.296489:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549c00, rc 0) 00000100:00100000:1.0:1784404763.296619:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:11133:x1871083707859328:12345-192.168.202.42@tcp:101:bash.0 Request processed in 894us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404763.296627:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:1.0:1784404763.308723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.311396:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707859584 00000100:00100000:0.0:1784404763.311421:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707859584 00000100:00100000:0.0:1784404763.311568:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:0.0:1784404763.311592:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:11133:x1871083707859584:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404763.311624:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404763.311656:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd790fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71d5 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.312196:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.312225:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.312237:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.312325:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.312362:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.312379:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784404763.313918:0:9527:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784404763.314241:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314258:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314269:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314310:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314318:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314325:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314332:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ba00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404763.314336:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314344:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314374:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404763.314377:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404763.314382:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314388:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79101 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784404763.314403:0:9527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091ae7901 reply state 00000000076b3d4b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314414:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314419:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:0.0:1784404763.314421:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784404763.314424:0:9527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784404763.314461:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd790fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314475:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.314483:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd44330f900) 00010000:00010000:0.0:1784404763.314486:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404763.314488:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a600, rc 0) 00000100:00100000:0.0:1784404763.314657:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11133:x1871083707859584:12345-192.168.202.42@tcp:101:bash.0 Request processed in 3078us (5942us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1784404763.314667:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:3.0:1784404763.324522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.324634:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707859712 00000100:00100000:1.0:1784404763.324644:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707859712 00000100:00100000:1.0:1784404763.324693:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1784404763.324701:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1871083707859712:12345-192.168.202.42@tcp:8:bash.0 00010000:00080000:1.0:1784404763.324752:0:8431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:1.0:1784404763.324783:0:8431:0:(genops.c:1385:class_connect()) connect: client 1827e730-172d-4769-8ecb-95f4e65fc8a0, cookie 0x24b3e2e6dcd7911d 00002000:00100000:1.0:1784404763.324807:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1827e730-172d-4769-8ecb-95f4e65fc8a0/ffff9dd443cf0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784404763.324826:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784404763.324950:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784404763.324981:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd443cf2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404763.325061:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2400:x1871083707859712:12345-192.168.202.42@tcp:8:bash.0 Request processed in 358us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404763.325069:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:2.0:1784404763.335967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404763.336218:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707859840 00000100:00100000:3.0:1784404763.336229:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707859840 00000100:00100000:3.0:1784404763.336311:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:3.0:1784404763.336324:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:0:x1871083707859840:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404763.336346:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404763.336375:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71dc expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404763.336404:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404763.336439:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1784404763.336444:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404763.336455:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.336476:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.336489:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7800, rc 0) 00000100:00100000:3.0:1784404763.336559:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:0:x1871083707859840:12345-192.168.202.42@tcp:101:bash.0 Request processed in 237us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.336566:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00080000:0.0:1784404763.336651:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404763.344787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.344932:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707859968 00000100:00100000:1.0:1784404763.344943:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707859968 00000100:00100000:1.0:1784404763.345001:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:1.0:1784404763.345023:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:11133:x1871083707859968:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404763.345049:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404763.345070:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71e3 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.345100:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.345121:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404763.345126:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404763.345131:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.345166:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.345188:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 8 pid: 8433 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404763.345203:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1871083728917632:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404763.345293:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404763.352718:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404763.353242:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707860096 00000100:00100000:2.0:1784404763.353253:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707860096 00010000:00010000:2.0:1784404763.353297:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 9 pid: 8433 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404763.353342:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:2.0:1784404763.353352:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2404:x1871083707860096:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404763.353368:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404763.353389:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 9 pid: 8433 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.353403:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 9 pid: 8433 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.353433:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404763.353438:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404763.353447:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.353459:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404763.353500:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404763.353514:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443768000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1871083728917760:192.168.202.42@tcp:105: 00000100:00100000:2.0:1784404763.353627:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4434789c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784404763.357626:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79124 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71dc expref: 9 pid: 8433 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404763.357651:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1871083728917632:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404763.357683:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.357698:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549800, rc 0) 00000100:00100000:3.0:1784404763.357758:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:11133:x1871083707859968:12345-192.168.202.42@tcp:101:bash.0 Request processed in 12737us (12978us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.357767:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1784404763.358286:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443768000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1871083728917760:192.168.202.42@tcp:105: 00010000:00010000:3.0:1784404763.358301:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404763.358447:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707860096:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 5096us (5740us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.358457:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:1.0:1784404763.379015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.379236:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707860352 00000100:00100000:0.0:1784404763.379250:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707860352 00000100:00100000:0.0:1784404763.379323:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1784404763.379336:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11133:x1871083707860352:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:0.0:1784404763.381132:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11133:x1871083707860352:12345-192.168.202.42@tcp:35:bash.0 Request processed in 1789us (2117us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784404763.381145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:2.0:1784404763.504503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.504904:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707860608 00000100:00100000:1.0:1784404763.504915:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707860608 00000100:00100000:1.0:1784404763.504983:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:1.0:1784404763.504993:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11143:x1871083707860608:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404763.505181:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404763.505206:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404763.505312:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784404763.505423:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79132 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ea expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.505437:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:1.0:1784404763.505441:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784404763.505447:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ea expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.505464:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548c00, rc 0) 00000100:00100000:1.0:1784404763.505554:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:11143:x1871083707860608:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 562us (1063us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1784404763.505561:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:3.0:1784404763.508342:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.508438:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707860864 00000100:00100000:0.0:1784404763.508450:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707860864 00000100:00100000:0.0:1784404763.508503:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784404763.508514:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:11143:x1871083707860864:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1784404763.508750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:11143:x1871083707860864:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 237us (416us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784404763.508758:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1784404763.611359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404763.611461:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707860992 00000100:00100000:3.0:1784404763.611473:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707860992 00000100:00100000:3.0:1784404763.611542:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1784404763.611553:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:11149:x1871083707860992:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404763.611578:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404763.611600:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71f1 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.611669:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.611685:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.611698:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404763.611745:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784404763.611749:0:13543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404763.611772:0:13543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.611797:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71f1 expref: 20 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.611816:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71f1 expref: 19 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.612030:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:3.0:1784404763.612034:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404763.612038:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7e00, rc 0) 00000100:00100000:3.0:1784404763.612207:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11149:x1871083707860992:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 655us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.612214:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:2.0:1784404763.620446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.620632:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707861248 00000100:00100000:0.0:1784404763.620643:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707861248 00000100:00100000:0.0:1784404763.620709:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1784404763.620720:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11149:x1871083707861248:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404763.620741:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404763.620762:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7914e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71f8 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.621085:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79155 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.621114:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.621129:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79155 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404763.621142:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784404763.621274:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7914e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71f8 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.621296:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79155 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71f8 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.621307:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd44330f900) 00010000:00010000:1.0:1784404763.621310:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404763.621315:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548c00, rc 0) 00000100:00100000:1.0:1784404763.621394:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11149:x1871083707861248:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 676us (958us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1784404763.621403:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:2.0:1784404763.631013:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404763.631070:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.631161:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707861632 00000100:00100000:1.0:1784404763.631174:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707861632 00000100:00100000:1.0:1784404763.631238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:1.0:1784404763.631250:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11149:x1871083707861632:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404763.631292:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404763.631314:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd79163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed71ff expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.631432:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7916a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.631449:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7916a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.631461:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7916a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404763.631474:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784404763.631590:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd79163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ff expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.631607:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7916a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ff expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.631615:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd44330f900) 00010000:00010000:1.0:1784404763.631619:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784404763.631622:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549e00, rc 0) 00000100:00100000:1.0:1784404763.631691:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:11149:x1871083707861632:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 444us (620us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1784404763.631699:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1784404763.632495:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707861376 00000100:00100000:0.0:1784404763.632504:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707861376 00000100:00100000:0.0:1784404763.632563:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1784404763.632583:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:2401:x1871083707861376:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404763.632596:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404763.632614:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79155 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71f8 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.632629:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd44330f900) 00010000:00010000:0.0:1784404763.632633:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404763.634222:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2401:x1871083707861376:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1629us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404763.634236:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1784404763.647434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404763.648450:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707861760 00000100:00100000:3.0:1784404763.648463:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707861760 00000100:00100000:3.0:1784404763.648533:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:3.0:1784404763.648544:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707861760:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:3.0:1784404763.648586:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.648607:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.648615:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404763.648620:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404763.648625:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.648662:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.648675:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 7 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404763.648703:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1871083728917888:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404763.648816:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028240 going to sleep for 11 seconds 00000040:00080000:2.0:1784404763.654212:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784404763.655512:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784404763.663020:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1871083728917888:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404763.663055:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404763.667427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.667921:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707861888 00000100:00100000:1.0:1784404763.667932:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707861888 00002000:00100000:1.0:1784404763.667984:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9dd541324000 x1871083707861888/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:24/0 lens 504/0 e 0 to 0 dl 1784404774 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784404763.668006:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd541324000 with x1871083707861888 ext(0->12) 00010000:00010000:1.0:1784404763.668018:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 8 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.668036:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 8 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784404763.668045:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd541324000 00000100:00100000:1.0:1784404763.668082:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1784404763.668092:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707861888:12345-192.168.202.42@tcp:4:lfs.0 00000001:00100000:2.0:1784404763.672088:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000100:00100000:1.0:1784404763.673063:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707861888:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 4962us (5635us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784404763.673078:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00002000:00100000:1.0:1784404763.673091:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9dd541324000 x1871083707861888/t4294967300(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:24/0 lens 504/448 e 0 to 0 dl 1784404774 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784404763.673112:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd541324000 with x1871083707861888 ext(0->12) 00010000:00010000:1.0:1784404763.673123:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.673141:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784404763.673148:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd541324000 00000100:00100000:2.0:1784404763.686906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.691843:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707862016 00000100:00100000:0.0:1784404763.691902:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707862016 00010000:00010000:0.0:1784404763.691957:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404763.691996:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1784404763.692007:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707862016:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404763.692023:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784404763.692041:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784404763.692044:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1784404763 00002000:00010000:0.0:1784404763.692047:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1784404764 00002000:00010000:0.0:1784404763.692049:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1784404763 00002000:00010000:0.0:1784404763.692051:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784404763.692058:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.692093:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.692152:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009adf5fd2/0x24b3e2e6dcd7912b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71e3 expref: 9 pid: 8431 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.692172:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404763.692177:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404763.692183:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.692192:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.692222:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404763.692289:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707862016:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 284us (5441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404763.692297:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00010000:00010000:3.0:1784404763.692672:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692682:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692702:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692711:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692718:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692725:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404763.692729:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692746:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692758:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.692765:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae389c19/0x24b3e2e6dcd79178 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404763.692836:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707861760:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 44293us (45412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.692845:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:2.0:1784404763.696349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.696443:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707862272 00000100:00100000:0.0:1784404763.696453:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707862272 00000100:00100000:0.0:1784404763.696513:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1784404763.696523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:11149:x1871083707862272:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:0.0:1784404763.696586:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7916a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ff expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404763.696842:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1784404763.697041:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1784404763.697358:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1784404763.697398:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.697415:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.697425:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.697459:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.697474:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 26 pid: 9527 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404763.697489:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f77b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728918016:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404763.697592:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4422659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404763.704623:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f77b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728918016:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404763.704659:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404763.711349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404763.711435:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707862400 00000100:00100000:3.0:1784404763.711444:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707862400 00010000:00010000:3.0:1784404763.711483:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 27 pid: 9527 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404763.711526:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:3.0:1784404763.711537:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:2404:x1871083707862400:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404763.711553:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404763.711560:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 27 pid: 9527 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.711574:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 27 pid: 9527 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.711614:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7910f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71d5 expref: 27 pid: 9527 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.711630:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd44330f900) 00010000:00010000:3.0:1784404763.711636:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.711646:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.711652:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.711740:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404763.712172:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:2404:x1871083707862400:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 270us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.712180:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00010000:00010000:1.0:1784404763.713200:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.713228:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784404763.713352:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1784404763.713463:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1784404763.713555:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e17b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728918144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404763.713616:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404763.713651:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784404763.713759:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728918144 00000100:00100000:2.0:1784404763.713766:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728918144 00000100:00100000:2.0:1784404763.713878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784404763.713888:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1871083728918144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784404763.713971:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1871083728918144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404763.713978:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1784404763.714276:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404763.714387:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e17b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728918144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784404763.714545:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1784404763.714596:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e17b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728918272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404763.714629:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404763.714697:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784404763.723488:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728918272 00000100:00100000:2.0:1784404763.723508:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728918272 00000100:00100000:2.0:1784404763.723593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784404763.723604:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1871083728918272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784404763.723841:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1871083728918272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 239us (9211us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784404763.723871:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784404763.724269:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e17b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728918272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784404763.724351:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1784404763.724405:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.724417:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.724426:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.724433:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404763.724437:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.724457:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.724476:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd44330f900) 00010000:00010000:1.0:1784404763.724479:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784404763.724484:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.724490:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7917f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784404763.724607:0:6522:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784404763.724676:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1784404763.724689:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381608836635ns, next at 382608833942ns, rc = 0 00000001:00080000:1.0:1784404763.724696:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1784404763.724719:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd44330f900) 00010000:00010000:1.0:1784404763.724722:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784404763.724729:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7916a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ff expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404763.724879:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:11149:x1871083707862272:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 28357us (28540us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1784404763.724895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000020:00080000:1.0:1784404763.724899:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784404763.735241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404763.735326:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707862528 00000100:00100000:3.0:1784404763.735338:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707862528 00000100:00100000:3.0:1784404763.735400:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:3.0:1784404763.735411:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:11149:x1871083707862528:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404763.735435:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404763.735460:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79186 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7206 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.735525:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79186 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7206 expref: 30 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.735563:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79186 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7206 expref: 30 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404763.735582:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404763.735585:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404763.735588:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7800, rc 0) 00000100:00100000:3.0:1784404763.735655:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:11149:x1871083707862528:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 247us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.735662:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:2.0:1784404763.744082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.744244:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707862784 00000100:00100000:1.0:1784404763.744258:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707862784 00000100:00100000:1.0:1784404763.744333:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:1.0:1784404763.744343:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:11149:x1871083707862784:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784404763.744629:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+31:11149:x1871083707862784:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 288us (561us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1784404763.744637:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:0.0:1784404763.820224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.820325:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707863040 00000100:00100000:1.0:1784404763.820336:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707863040 00000100:00100000:1.0:1784404763.820397:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1784404763.820407:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+31:11159:x1871083707863040:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404763.820430:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404763.820449:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7918d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed720d expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404763.820551:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784404763.820642:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7918d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed720d expref: 33 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.820657:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:1.0:1784404763.820660:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784404763.820665:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7918d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed720d expref: 33 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.820679:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549e00, rc 0) 00000100:00100000:1.0:1784404763.820737:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:11159:x1871083707863040:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 333us (523us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1784404763.820744:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:2.0:1784404763.823480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.823574:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707863168 00000100:00100000:1.0:1784404763.823585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707863168 00000100:00100000:1.0:1784404763.823649:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:1.0:1784404763.823671:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:11159:x1871083707863168:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:1.0:1784404763.823756:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823770:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823779:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823787:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823793:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823800:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823909:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823919:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823924:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784404763.823967:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823978:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823988:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823993:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.823997:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404763.824002:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824010:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824021:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404763.824024:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404763.824029:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824035:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd7919b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824050:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824057:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824062:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824068:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404763.824077:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824084:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824092:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:1.0:1784404763.824094:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404763.824108:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824115:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824126:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824131:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824136:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824141:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404763.824143:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824149:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824155:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404763.824157:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404763.824166:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404763.824172:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404763.824443:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:11159:x1871083707863168:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 773us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404763.824449:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:2.0:1784404763.829562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.829662:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707863424 00000100:00100000:1.0:1784404763.829673:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707863424 00000100:00100000:1.0:1784404763.829739:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784404763.829751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:11159:x1871083707863424:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784404763.830051:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+33:11159:x1871083707863424:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 302us (501us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1784404763.830061:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:0.0:1784404763.852278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.852337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.852375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.852409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.852435:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707863680 00000100:00100000:0.0:1784404763.852442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707863680 00000100:00100000:0.0:1784404763.852486:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707863936 00000100:00100000:0.0:1784404763.852488:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707863936 00000100:00100000:0.0:1784404763.852499:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707863808 00000100:00100000:0.0:1784404763.852500:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707863808 00000100:00100000:0.0:1784404763.852512:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 264 00000100:00100000:0.0:1784404763.852519:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707863680:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404763.852584:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707863680:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404763.852589:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 264 00000100:00100000:0.0:1784404763.852603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 265 00000100:00100000:0.0:1784404763.852606:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707863936:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404763.852619:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707863936:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 13us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404763.852623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 265 00000100:00100000:0.0:1784404763.852629:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 266 00000100:00100000:0.0:1784404763.852632:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707863808:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404763.852644:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707863808:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 12us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404763.852648:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 266 00000100:00080000:0.0:1784404763.852657:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404763.852660:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404763.852738:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707863552 00000100:00100000:3.0:1784404763.852741:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707863552 00000100:00100000:3.0:1784404763.852768:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 374 00000100:00100000:3.0:1784404763.852773:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707863552:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404763.852809:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707863552:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 36us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404763.852815:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 374 00000100:00100000:2.0:1784404763.869639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.869726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707864192 00000100:00100000:0.0:1784404763.869735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707864192 00000100:00100000:0.0:1784404763.869835:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:0.0:1784404763.869902:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+33:11162:x1871083707864192:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404763.869927:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404763.869945:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd791b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7214 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870021:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870038:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870052:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870065:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870072:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870078:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870202:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870209:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870227:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404763.870236:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784404763.870298:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870303:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870308:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870311:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404763.870314:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870318:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870326:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404763.870328:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404763.870331:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870335:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd791b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870344:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870347:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870357:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870361:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ac00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404763.870362:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870366:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870370:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:0.0:1784404763.870371:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404763.870373:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870376:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870402:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd791b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870411:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.870416:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404763.870417:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404763.870419:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:0.0:1784404763.870482:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:11162:x1871083707864192:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 584us (853us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1784404763.870494:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:2.0:1784404763.875231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404763.875277:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707864320 00000100:00100000:0.0:1784404763.875289:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707864320 00000100:00100000:0.0:1784404763.875359:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:0.0:1784404763.875371:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:11162:x1871083707864320:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1784404763.875446:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875464:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875476:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875512:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875520:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875527:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875532:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ae00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404763.875536:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875542:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875555:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404763.875571:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404763.875576:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404763.875582:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd791d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404763.875661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:11162:x1871083707864320:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 291us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404763.875669:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:2.0:1784404763.879267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404763.879377:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707864576 00000100:00100000:1.0:1784404763.879389:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707864576 00000100:00100000:1.0:1784404763.879445:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1784404763.879457:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:11162:x1871083707864576:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784404763.879674:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+36:11162:x1871083707864576:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 219us (418us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1784404763.879682:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00010000:00010000:0.0:1784404763.912208:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404764.035793:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404764.035821:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728918400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404764.035938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404764.037037:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728918400 00000100:00100000:2.0:1784404764.037047:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728918400 00000100:00100000:2.0:1784404764.037143:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784404764.037154:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728918400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404764.037206:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1784404764.037292:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728918400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404764.037300:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784404764.038033:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728918400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404764.091485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404764.091626:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707864832 00000100:00100000:1.0:1784404764.091638:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707864832 00000100:00100000:1.0:1784404764.091759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:1.0:1784404764.091771:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+36:11193:x1871083707864832:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:1.0:1784404764.091813:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404764.091847:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed721b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.091978:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.091993:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.092016:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404764.092028:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784404764.092198:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd791da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed721b expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.092222:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed721b expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.092244:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404764.092247:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404764.092251:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549800, rc 0) 00000100:00100000:1.0:1784404764.092319:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:11193:x1871083707864832:12345-192.168.202.42@tcp:101:cat.0 Request processed in 551us (844us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1784404764.092327:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:2.0:1784404764.098666:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404764.098714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404764.098806:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707865088 00000100:00100000:0.0:1784404764.098816:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707865088 00000100:00100000:0.0:1784404764.098910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1784404764.098919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:11193:x1871083707865088:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:0.0:1784404764.099204:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:11193:x1871083707865088:12345-192.168.202.42@tcp:35:cat.0 Request processed in 285us (548us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1784404764.099212:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:3.0:1784404764.099951:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707865216 00000100:00100000:3.0:1784404764.099958:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707865216 00000100:00100000:3.0:1784404764.100078:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1784404764.100087:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:2404:x1871083707865216:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404764.100125:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404764.100150:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd791e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed721b expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.100178:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404764.100183:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404764.100219:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:2404:x1871083707865216:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 133us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404764.100231:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:1.0:1784404764.182693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404764.182797:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707865472 00000100:00100000:0.0:1784404764.182807:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707865472 00000100:00100000:0.0:1784404764.182914:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:0.0:1784404764.182924:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:11199:x1871083707865472:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:0.0:1784404764.182949:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404764.182952:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784404764.182977:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71f1 expref: 38 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.182996:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404764.183016:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404764.183030:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd791ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7222 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.183146:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.183161:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.183409:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.183447:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.183461:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 38 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404764.183476:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728918528:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404764.183658:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265600 going to sleep for 11 seconds 00000100:00100000:0.0:1784404764.189240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404764.189690:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707865600 00000100:00100000:1.0:1784404764.189701:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707865600 00010000:00010000:1.0:1784404764.189764:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 39 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404764.189813:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1784404764.189824:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:2403:x1871083707865600:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404764.189880:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404764.189889:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 39 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.189903:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 39 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.189925:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404764.189930:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.189940:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.189949:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.189971:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404764.190035:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:2403:x1871083707865600:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 212us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404764.190043:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00010000:00010000:3.0:1784404764.190761:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd791c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7214 expref: 38 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404764.190779:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728918528:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404764.190799:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.190809:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.190816:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404764.190847:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784404764.191039:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd791ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.191055:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.191078:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404764.191081:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784404764.191084:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ac00, rc 0) 00000100:00100000:3.0:1784404764.191150:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:11199:x1871083707865472:12345-192.168.202.42@tcp:101:dd.0 Request processed in 8227us (8467us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1784404764.191158:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:0.0:1784404764.200737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404764.201086:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707865728 00000100:00100000:1.0:1784404764.201108:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707865728 00000100:00100000:1.0:1784404764.201189:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:1.0:1784404764.201217:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:11199:x1871083707865728:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1784404764.201546:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404764.201574:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd79204 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7229 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.201618:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.201638:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.201651:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.201794:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd79204 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.201816:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.201826:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404764.201829:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404764.201834:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549e00, rc 0) 00000100:00100000:1.0:1784404764.202213:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:11199:x1871083707865728:12345-192.168.202.42@tcp:101:dd.0 Request processed in 998us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404764.202221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:0.0:1784404764.205721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404764.205809:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707865984 00000100:00100000:1.0:1784404764.205819:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707865984 00000100:00100000:1.0:1784404764.205920:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1784404764.205944:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:11199:x1871083707865984:12345-192.168.202.42@tcp:36:dd.0 00010000:00010000:1.0:1784404764.206207:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.206604:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.206618:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784404764.206666:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1784404764.206691:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024f6d867 reply state 000000006bff15ea transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.206703:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.206711:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404764.206713:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784404764.206717:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784404764.206806:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+42:11199:x1871083707865984:12345-192.168.202.42@tcp:36:dd.0 Request processed in 863us (1093us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1784404764.206814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000020:00080000:1.0:1784404764.206819:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784404764.542609:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404764.545213:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707866112 00000100:00100000:3.0:1784404764.545229:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707866112 00000100:00100000:3.0:1784404764.545748:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1784404764.545764:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+42:11214:x1871083707866112:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:3.0:1784404764.545802:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404764.545826:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd79219 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7230 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.545933:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.545948:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.545960:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.545972:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.546165:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.546192:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.546271:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.546283:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.546292:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.546431:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.546447:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 43 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404764.546462:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728918656:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404764.546596:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028780 going to sleep for 11 seconds 00000100:00100000:2.0:1784404764.555791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404764.556004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707866368 00000100:00100000:1.0:1784404764.556015:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707866368 00000100:00100000:1.0:1784404764.556086:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:1.0:1784404764.556109:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:6170:x1871083707866368:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784404764.556491:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+45:6170:x1871083707866368:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 385us (708us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1784404764.556509:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1784404764.557183:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728918656:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404764.557210:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404764.563491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404764.563700:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707866496 00000100:00100000:2.0:1784404764.563710:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707866496 00010000:00010000:2.0:1784404764.563753:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 45 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404764.563931:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:2.0:1784404764.563941:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+45:2403:x1871083707866496:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404764.563957:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404764.563988:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 45 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404764.564002:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 45 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404764.564027:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd791f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7222 expref: 45 pid: 6520 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404764.564044:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:2.0:1784404764.564050:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404764.564060:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404764.564067:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404764.564103:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404764.564176:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:2403:x1871083707866496:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 236us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404764.564184:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00010000:00010000:0.0:1784404764.564247:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564256:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404764.564315:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784404764.564331:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404764.564368:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564382:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564391:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564397:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564403:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564408:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404764.564413:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564419:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564428:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404764.564431:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404764.564434:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564440:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79220 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564462:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564468:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564473:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564478:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404764.564480:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564485:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564493:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:0.0:1784404764.564495:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404764.564498:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564503:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd79227 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564537:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd79219 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7230 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564551:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7230 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.564570:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404764.564572:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404764.564575:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6400, rc 0) 00000100:00100000:0.0:1784404764.564601:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:11214:x1871083707866112:12345-192.168.202.42@tcp:101:stat.0 Request processed in 18844us (22006us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404764.564607:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:2.0:1784404764.662914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404764.663314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707866752 00000100:00100000:1.0:1784404764.663326:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707866752 00000100:00100000:1.0:1784404764.663395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:1.0:1784404764.663407:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:11220:x1871083707866752:12345-192.168.202.42@tcp:36:truncate.0 00010000:00010000:1.0:1784404764.663513:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404764.663542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd7922e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7230 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.663562:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404764.663567:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404764.663745:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.663759:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.663770:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784404764.663812:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1784404764.663831:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c841e86 reply state 000000006b74072f transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.663842:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404764.663848:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404764.663949:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784404764.663952:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784404764.664135:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+45:11220:x1871083707866752:12345-192.168.202.42@tcp:36:truncate.0 Request processed in 728us (1230us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784404764.664143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000020:00080000:1.0:1784404764.664148:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784404764.893923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404764.894116:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707866880 00000100:00100000:3.0:1784404764.894127:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707866880 00000100:00100000:3.0:1784404764.894203:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:3.0:1784404764.894216:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+45:11234:x1871083707866880:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:3.0:1784404764.894267:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404764.894289:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7923c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7237 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894371:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894386:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894398:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894411:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894418:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894425:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894496:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894505:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894512:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404764.894558:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1784404764.894582:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404764.894610:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894623:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894632:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894638:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894645:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894651:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404764.894655:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894663:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894675:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:3.0:1784404764.894679:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404764.894683:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894690:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79243 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894706:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894722:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894728:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894733:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404764.894737:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894743:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894752:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:3.0:1784404764.894755:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404764.894757:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894764:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7924a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894793:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7923c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 47 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894809:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 46 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404764.894817:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404764.894819:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404764.894830:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7200, rc 0) 00000100:00100000:3.0:1784404764.894946:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+46:11234:x1871083707866880:12345-192.168.202.42@tcp:101:stat.0 Request processed in 732us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404764.894954:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00010000:00010000:3.0:1784404764.931040:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404764.982323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404764.983166:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707867136 00000100:00100000:0.0:1784404764.983180:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707867136 00000100:00100000:0.0:1784404764.983254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:0.0:1784404764.983265:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+46:11244:x1871083707867136:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404764.983287:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404764.983309:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed723e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404764.983469:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784404764.983584:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79258 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed723e expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.983610:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:0.0:1784404764.983613:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404764.983618:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed723e expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404764.983635:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a800, rc 0) 00000100:00100000:0.0:1784404764.983740:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+47:11244:x1871083707867136:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 476us (1429us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1784404764.983758:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:2.0:1784404764.987528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404764.987652:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707867392 00000100:00100000:1.0:1784404764.987663:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707867392 00000100:00100000:1.0:1784404764.987724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1784404764.987735:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+47:11244:x1871083707867392:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784404764.988035:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+48:11244:x1871083707867392:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 301us (614us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1784404764.988042:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:2.0:1784404765.071679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.071819:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707867648 00000100:00100000:1.0:1784404765.071828:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707867648 00000100:00100000:1.0:1784404765.071941:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1784404765.071953:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+48:11250:x1871083707867648:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404765.071977:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1784404765.072196:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784404765.072241:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd79266 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7245 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.072381:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.072397:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 49 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.072417:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.072451:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 49 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.072466:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 49 pid: 9527 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.072480:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728918784:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404765.072649:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404765.075251:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728918784:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404765.075283:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404765.077286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.080584:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707867776 00000100:00100000:1.0:1784404765.080603:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707867776 00010000:00010000:1.0:1784404765.080677:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 50 pid: 9527 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.080731:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:1.0:1784404765.080742:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:2403:x1871083707867776:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404765.080757:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404765.080765:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 50 pid: 9527 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.080811:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 50 pid: 9527 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.080834:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79251 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7237 expref: 50 pid: 9527 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.080913:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404765.080919:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.080931:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.080939:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.080965:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404765.081208:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.081217:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404765.081236:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1784404765.081373:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548a00/0x24b3e2e6dcd79266 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.081390:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.081396:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404765.081399:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404765.081402:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758600, rc 0) 00000100:00100000:0.0:1784404765.081471:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:11250:x1871083707867648:12345-192.168.202.42@tcp:101:bash.0 Request processed in 9522us (9802us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1784404765.081479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1784404765.081686:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+49:2403:x1871083707867776:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 946us (4408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.081694:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:3.0:1784404765.108393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.108550:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707868032 00000100:00100000:0.0:1784404765.108562:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707868032 00000100:00100000:0.0:1784404765.108643:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:0.0:1784404765.108654:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+49:11250:x1871083707868032:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:0.0:1784404765.109033:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.109079:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.109105:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404765.109160:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1784404765.109184:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2a532bd reply state 000000002b69a898 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.109198:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.109205:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404765.109208:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784404765.109212:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784404765.109304:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11250:x1871083707868032:12345-192.168.202.42@tcp:36:bash.0 Request processed in 652us (923us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1784404765.109313:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000020:00080000:0.0:1784404765.109317:0:13543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784404765.114085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.114207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707868160 00000100:00100000:1.0:1784404765.114217:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707868160 00000100:00100000:1.0:1784404765.114282:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:1.0:1784404765.114293:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11250:x1871083707868160:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404765.114319:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404765.114342:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79282 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed724c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.114466:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.114482:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.114491:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.114534:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.114549:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 53 pid: 6519 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.114566:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728918912:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404765.114687:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712900 going to sleep for 11 seconds 00000100:00100000:2.0:1784404765.117802:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.117928:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707868288 00000100:00100000:3.0:1784404765.117938:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707868288 00010000:00010000:3.0:1784404765.117978:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 54 pid: 6519 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.118030:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1784404765.118041:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:2404:x1871083707868288:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404765.118057:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404765.118064:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 54 pid: 6519 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.118076:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 54 pid: 6519 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.118112:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.118117:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.118129:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.118137:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.118168:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404765.118227:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:2404:x1871083707868288:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 187us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.118236:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00010000:00010000:1.0:1784404765.118786:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7926d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7245 expref: 53 pid: 6519 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.118806:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728918912:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404765.118829:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.118848:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.118923:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404765.118980:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784404765.118995:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404765.119019:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.119051:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79282 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed724c expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.119067:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed724c expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.119075:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404765.119077:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404765.119080:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758800, rc 0) 00000100:00100000:1.0:1784404765.119126:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11250:x1871083707868160:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4835us (5052us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.119133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:2.0:1784404765.126384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.129185:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707868544 00000100:00100000:1.0:1784404765.129204:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707868544 00000100:00100000:1.0:1784404765.129347:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:1.0:1784404765.129361:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11250:x1871083707868544:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:1.0:1784404765.129642:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+53:11250:x1871083707868544:12345-192.168.202.42@tcp:35:bash.0 Request processed in 283us (3271us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1784404765.129650:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1784404765.218361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.218474:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707868800 00000100:00100000:1.0:1784404765.218484:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707868800 00000100:00100000:1.0:1784404765.218552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:1.0:1784404765.218565:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+53:11260:x1871083707868800:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404765.218595:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404765.218619:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7253 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404765.218737:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784404765.218905:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79290 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7253 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.218919:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:1.0:1784404765.218922:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784404765.218926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7253 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.218942:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759e00, rc 0) 00000100:00100000:1.0:1784404765.219008:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11260:x1871083707868800:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 446us (658us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1784404765.219016:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1784404765.224343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.224680:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707868928 00000100:00100000:3.0:1784404765.224691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707868928 00000100:00100000:3.0:1784404765.224798:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:3.0:1784404765.224809:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11260:x1871083707868928:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:3.0:1784404765.224917:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.224934:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.224947:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.224959:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.224967:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.224974:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225056:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225068:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225101:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404765.225155:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225177:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225185:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225192:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225199:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.225204:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225213:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225226:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:3.0:1784404765.225229:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404765.225233:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225239:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7929e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225254:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225266:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225272:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225277:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.225280:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225286:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225294:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:3.0:1784404765.225297:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404765.225299:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225306:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225316:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225323:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225328:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225333:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.225343:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225349:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225358:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.225361:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404765.225364:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.225370:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.225453:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11260:x1871083707868928:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 644us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.225461:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:2.0:1784404765.228139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.228244:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707869184 00000100:00100000:0.0:1784404765.228255:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707869184 00000100:00100000:0.0:1784404765.228314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1784404765.228327:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11260:x1871083707869184:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1784404765.228729:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:11260:x1871083707869184:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 404us (600us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1784404765.228739:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1784404765.254943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.255015:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707869440 00000100:00100000:1.0:1784404765.255026:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707869440 00000100:00100000:1.0:1784404765.255101:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:1.0:1784404765.255113:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:11263:x1871083707869440:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404765.255145:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404765.255242:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed725a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255336:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255352:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255363:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255374:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255388:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255496:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd792c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255506:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd792c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255513:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd792c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404765.255524:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784404765.255699:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255708:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255721:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255728:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.255733:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255741:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255754:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404765.255757:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.255762:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255769:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd792ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255785:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255792:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255798:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255803:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.255806:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255823:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255833:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:1.0:1784404765.255835:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.255838:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.255845:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd792c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.256026:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed725a expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.256040:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd792c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed725a expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.256047:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404765.256050:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404765.256052:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758a00, rc 0) 00000100:00100000:1.0:1784404765.256173:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:11263:x1871083707869440:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1061us (1238us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1784404765.256181:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:2.0:1784404765.258799:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.260537:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707869568 00000100:00100000:1.0:1784404765.260552:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707869568 00000100:00100000:1.0:1784404765.260660:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1784404765.260673:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:2403:x1871083707869568:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404765.260708:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404765.260737:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd792c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed725a expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.260757:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404765.260762:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404765.260824:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:2403:x1871083707869568:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 155us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.260831:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:2.0:1784404765.264692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.264808:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707869696 00000100:00100000:0.0:1784404765.264821:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707869696 00000100:00100000:0.0:1784404765.264928:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:0.0:1784404765.264938:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:11263:x1871083707869696:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1784404765.265158:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265250:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265263:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265300:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265308:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265315:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265333:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404765.265338:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265346:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265358:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404765.265362:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404765.265379:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.265386:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd792d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404765.265506:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:11263:x1871083707869696:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 568us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.265514:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:0.0:1784404765.268900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.269012:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707869952 00000100:00100000:1.0:1784404765.269023:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707869952 00000100:00100000:1.0:1784404765.269096:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1784404765.269109:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:11263:x1871083707869952:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784404765.269366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:11263:x1871083707869952:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 259us (477us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1784404765.269374:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:2.0:1784404765.435766:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.435881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707870208 00000100:00100000:3.0:1784404765.435892:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707870208 00000100:00100000:3.0:1784404765.435960:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:3.0:1784404765.435971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:11281:x1871083707870208:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:3.0:1784404765.436005:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404765.436028:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7261 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.436150:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.436179:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.436213:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404765.436227:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784404765.436344:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd792dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7261 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.436364:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7261 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.436373:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.436376:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784404765.436380:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7a00, rc 0) 00000100:00100000:3.0:1784404765.436746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:11281:x1871083707870208:12345-192.168.202.42@tcp:101:cat.0 Request processed in 776us (990us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1784404765.436755:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:3.0:1784404765.463100:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.463219:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707870336 00000100:00100000:1.0:1784404765.463229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707870336 00000100:00100000:1.0:1784404765.463293:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:1.0:1784404765.463305:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:11282:x1871083707870336:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404765.463330:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404765.463348:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd792f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7268 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.463416:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.463452:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.463464:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404765.463509:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784404765.463514:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404765.463533:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.463558:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd792f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7268 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.463579:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7268 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.463585:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404765.463588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784404765.463590:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759e00, rc 0) 00000100:00100000:1.0:1784404765.463641:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11282:x1871083707870336:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 340us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.463646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:0.0:1784404765.470263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.470376:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707870720 00000100:00100000:1.0:1784404765.470386:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707870720 00000100:00100000:1.0:1784404765.470552:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404765.470564:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11282:x1871083707870720:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784404765.470965:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11282:x1871083707870720:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 402us (808us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1784404765.471341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:2.0:1784404765.474124:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.474320:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707870848 00000100:00100000:3.0:1784404765.474331:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707870848 00000100:00100000:3.0:1784404765.474406:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:3.0:1784404765.474416:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11282:x1871083707870848:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:3.0:1784404765.474430:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784404765.474456:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79289 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed724c expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.474477:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd792e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7261 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.474509:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79186 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7206 expref: 59 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.474519:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.474523:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404765.474588:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:11282:x1871083707870848:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 172us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.474595:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:3.0:1784404765.477162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.477248:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707870976 00000100:00100000:1.0:1784404765.477258:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707870976 00000100:00100000:1.0:1784404765.477316:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:1.0:1784404765.477326:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:11282:x1871083707870976:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:1.0:1784404765.477466:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.477485:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.477496:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404765.477739:0:9527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404765.477952:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1784404765.478052:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1784404765.478183:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:11282:x1871083707870976:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 856us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.478193:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:0.0:1784404765.530763:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.531263:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707871104 00000100:00100000:3.0:1784404765.531272:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707871104 00000100:00100000:3.0:1784404765.531336:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:3.0:1784404765.531344:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:11284:x1871083707871104:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404765.531362:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404765.531379:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79307 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed726f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531458:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531473:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531483:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531494:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531521:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531527:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531596:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531605:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531610:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404765.531643:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784404765.531646:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404765.531660:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531669:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531674:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531679:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531682:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531694:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.531697:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531702:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531712:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:3.0:1784404765.531714:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404765.531717:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531721:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7930e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531731:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531734:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531738:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531740:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.531742:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531745:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531755:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:3.0:1784404765.531757:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404765.531759:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531762:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79315 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531791:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79307 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531800:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.531804:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.531805:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404765.531807:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6e00, rc 0) 00000100:00100000:3.0:1784404765.531923:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:11284:x1871083707871104:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 580us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.531929:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00000040:00080000:2.0:1784404765.699211:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784404765.699221:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784404765.699261:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784404765.699270:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784404765.707782:0:13786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe17800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728919040:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784404765.707917:0:13786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404765.718654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.719484:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707871232 00000100:00100000:0.0:1784404765.719499:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707871232 00000100:00100000:0.0:1784404765.719564:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:0.0:1784404765.719575:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707871232:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784404765.719606:0:13543:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784404765.719725:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707871232:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 152us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.719733:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:1.0:1784404765.726220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.726517:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707871360 00000100:00100000:0.0:1784404765.726533:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707871360 00000100:00100000:0.0:1784404765.726598:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:0.0:1784404765.726609:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707871360:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00000100:00100000:2.0:1784404765.726630:0:13786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe17800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728919040:192.168.202.42@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1784404765.726690:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726708:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726735:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726805:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726814:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726821:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726849:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726874:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726880:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404765.726929:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784404765.726934:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404765.726947:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726957:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726964:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726980:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726986:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ba00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404765.726990:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.726998:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727011:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:0.0:1784404765.727015:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404765.727019:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727026:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79323 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727039:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727046:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727052:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727056:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404765.727059:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727076:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727096:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9dd44330f600) 00010000:00010000:0.0:1784404765.727099:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404765.727102:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727109:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7932a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727123:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727128:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727133:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727139:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ae00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404765.727141:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727148:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727155:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404765.727158:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404765.727160:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.727176:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79331 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404765.727264:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:11295:x1871083707871360:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 656us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.727272:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:2.0:1784404765.733499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.735664:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707871616 00000100:00100000:0.0:1784404765.735679:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707871616 00000100:00100000:0.0:1784404765.735749:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:0.0:1784404765.735760:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:11295:x1871083707871616:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784404765.735783:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404765.735805:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79338 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7276 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.735934:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.735952:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.735966:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404765.735979:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784404765.736068:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736076:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736104:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736110:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404765.736114:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736121:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736133:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404765.736136:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404765.736141:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736147:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7933f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736190:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79338 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7276 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736201:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:0.0:1784404765.736203:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404765.736207:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79338 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7276 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.736217:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ae00, rc 0) 00000100:00100000:0.0:1784404765.736295:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707871616:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 537us (2805us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1784404765.736314:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:2.0:1784404765.739233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.739317:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707871744 00000100:00100000:1.0:1784404765.739334:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707871744 00000100:00100000:1.0:1784404765.739393:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:1.0:1784404765.739403:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707871744:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784404765.739438:0:9527:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784404765.739568:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707871744:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 166us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.739589:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:2.0:1784404765.750936:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.751025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707872000 00000100:00100000:0.0:1784404765.751036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707872000 00000100:00100000:0.0:1784404765.751106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:0.0:1784404765.751118:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707872000:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784404765.751143:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404765.751146:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784404765.751174:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd792f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7268 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.751192:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404765.751198:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404765.751212:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7934d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed727d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784404765.751572:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1784404765.751718:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79354 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.751733:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.751744:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.751797:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7934d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed727d expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.751829:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed727d expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.751837:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330f600) 00010000:00010000:0.0:1784404765.751840:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404765.751844:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b000, rc 0) 00000100:00100000:0.0:1784404765.751942:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11295:x1871083707872000:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 827us (1014us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1784404765.751949:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:0.0:1784404765.775497:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404765.775576:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707872256 00000100:00100000:2.0:1784404765.775588:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707872256 00000100:00100000:2.0:1784404765.775687:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:2.0:1784404765.775699:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11295:x1871083707872256:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784404765.775762:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404765.775789:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed727d expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.775807:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330f600) 00010000:00010000:2.0:1784404765.775817:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404765.775842:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.775896:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.775907:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.775978:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.775987:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.775993:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776042:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776049:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776202:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776212:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404765.776217:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776225:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776234:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404765.776243:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404765.776248:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776254:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd79362 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776265:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776270:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776275:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776280:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404765.776283:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776289:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776296:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3e31470c (ffff9dd443416000) 00010000:00010000:2.0:1784404765.776298:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404765.776301:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.776307:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd79369 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3e31470c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404765.777267:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707872256:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1565us (1775us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784404765.777283:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:3.0:1784404765.785347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.785398:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707872384 00000100:00100000:0.0:1784404765.785409:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707872384 00000100:00100000:0.0:1784404765.788525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:0.0:1784404765.788548:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11295:x1871083707872384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784404765.788570:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404765.788595:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79370 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7284 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.788631:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.788644:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.788656:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.789005:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79370 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.789023:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.789031:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:0.0:1784404765.789033:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784404765.789036:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ae00, rc 0) 00000100:00100000:0.0:1784404765.789116:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11295:x1871083707872384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 578us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.789124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:0.0:1784404765.792339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.792430:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707872640 00000100:00100000:3.0:1784404765.792444:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707872640 00000100:00100000:3.0:1784404765.792509:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:3.0:1784404765.792521:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11295:x1871083707872640:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784404765.792620:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.792658:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.792670:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784404765.792915:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1784404765.792927:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383677074827ns, next at 384677072069ns, rc = 0 00000004:00010000:3.0:1784404765.792994:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a153b13 reply state 00000000e793192d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.793009:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.793017:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:3.0:1784404765.793021:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784404765.793025:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404765.793164:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11295:x1871083707872640:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 644us (836us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1784404765.793172:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 85 00000001:00080000:3.0:1784404765.797879:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:3.0:1784404765.797893:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1784404765.797965:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1784404765.797989:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd574eb3d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1784404765.797995:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd5452e8500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd574eb3f00 00000020:00080000:3.0:1784404765.797998:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd5452e8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd54a670400 00000100:00100000:3.0:1784404765.798142:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728919168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1784404765.798221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404765.798286:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728919168 00000100:00100000:3.0:1784404765.798292:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728919168 00000100:00100000:3.0:1784404765.798337:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784404765.798345:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728919168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1784404765.798499:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728919168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (277us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784404765.798506:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1784404765.798525:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1784404765.798558:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd570592d80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1784404765.798563:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728919168:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1784404765.798753:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798765:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798773:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798778:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.798783:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798791:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798806:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9dd443416800) 00010000:00010000:1.0:1784404765.798808:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.798812:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798820:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd790c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798840:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798846:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798884:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798889:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.798892:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798899:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798906:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404765.798909:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.798911:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798917:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd790c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798931:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798938:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798944:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798949:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151bc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.798951:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798964:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798972:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd44330f200) 00010000:00010000:1.0:1784404765.798974:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.798985:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.798991:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79108 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799006:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799012:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799018:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799022:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.799025:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799031:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799038:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404765.799040:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.799042:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799063:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549800/0x24b3e2e6dcd79212 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799074:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799080:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799094:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799099:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.799102:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799107:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799115:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404765.799118:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.799120:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799126:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443548c00/0x24b3e2e6dcd79235 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799136:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799142:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799155:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799160:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.799163:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799169:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799177:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:1.0:1784404765.799179:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404765.799181:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799186:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7927b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799199:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799205:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799210:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799214:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.799218:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799233:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799242:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:1.0:1784404765.799245:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784404765.799247:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.799253:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7937e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784404765.799277:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1784404765.799437:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1784404765.801943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.802024:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707872768 00000100:00100000:3.0:1784404765.802033:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707872768 00000100:00100000:3.0:1784404765.802217:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:3.0:1784404765.802229:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:11295:x1871083707872768:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404765.802254:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404765.802273:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed728b expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.802334:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 13 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.802348:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 13 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.802367:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:3.0:1784404765.802371:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404765.802390:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7000, rc 0) 00000100:00100000:3.0:1784404765.802457:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:11295:x1871083707872768:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 230us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.802464:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:2.0:1784404765.804508:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728919296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784404765.804579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404765.804651:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728919296 00000100:00100000:2.0:1784404765.804659:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728919296 00000100:00100000:2.0:1784404765.804707:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784404765.804717:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728919296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784404765.804742:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1784404765.805907:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a5bdb1b, atime: 0x6a5bdb1c, ctime: 0x6a5bdb1b, blocks: 0x8 00010000:00010000:2.0:1784404765.805923:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.805942:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1784404765.805947:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404765.805955:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.805973:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.805990:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.805998:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.806046:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784404765.806394:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083728919296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1676us (1812us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784404765.806404:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1784404765.806440:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404765.806446:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.806455:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404765.806459:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.806469:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.806486:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.806493:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7938c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.806515:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404765.806517:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404765.806518:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784404765.806526:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1784404765.806804:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd57fe14380/2, rc 0, transno 4294967302 00000100:00100000:1.0:1784404765.806812:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728919296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784404765.807671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.807754:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707872896 00000100:00100000:3.0:1784404765.807762:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707872896 00000100:00100000:3.0:1784404765.807814:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1784404765.807823:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1871083707872896:12345-192.168.202.42@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1784404765.807888:0:8488:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:3.0:1784404765.807919:0:8488:0:(genops.c:1385:class_connect()) connect: client 1827e730-172d-4769-8ecb-95f4e65fc8a0, cookie 0x24b3e2e6dcd79393 00002000:00100000:3.0:1784404765.807931:0:8488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1827e730-172d-4769-8ecb-95f4e65fc8a0/ffff9dd5462d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784404765.807949:0:8488:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784404765.808011:0:8488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784404765.808040:0:8488:0:(import.c:65:import_set_state_nolock()) ffff9dd5462d5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784404765.808122:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2400:x1871083707872896:12345-192.168.202.42@tcp:8:lhsmtool_posix.0 Request processed in 299us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.808129:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:3.0:1784404765.811996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404765.812116:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707873024 00000100:00100000:2.0:1784404765.812130:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707873024 00000100:00100000:2.0:1784404765.812206:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:2.0:1784404765.812216:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:0:x1871083707873024:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784404765.812655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1784404765.814389:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00100000:2.0:1784404765.814417:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000001:00080000:2.0:1784404765.814422:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1784404765.814622:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:0:x1871083707873024:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 2402us (2641us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784404765.814633:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:1.0:1784404765.834312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.834393:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707873280 00000100:00100000:0.0:1784404765.834403:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707873280 00000100:00100000:0.0:1784404765.834460:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:0.0:1784404765.834473:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:11295:x1871083707873280:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784404765.834739:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:11295:x1871083707873280:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 268us (436us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1784404765.834748:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1784404765.848346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.848419:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707873536 00000100:00100000:0.0:1784404765.848431:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707873536 00000100:00100000:0.0:1784404765.848497:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:0.0:1784404765.848509:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:11295:x1871083707873536:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784404765.848647:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:11295:x1871083707873536:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 140us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.848670:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:3.0:1784404765.851246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.851328:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707873664 00000100:00100000:0.0:1784404765.851338:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707873664 00000100:00100000:0.0:1784404765.851399:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:0.0:1784404765.851409:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:11295:x1871083707873664:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784404765.851430:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404765.851451:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7939a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7292 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.851519:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd793a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.851533:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd793a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.851547:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd793a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404765.851598:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404765.851619:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd793a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.851645:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7939a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7292 expref: 16 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.851664:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd793a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7292 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.851672:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:0.0:1784404765.851689:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784404765.851693:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:0.0:1784404765.851758:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707873664:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 350us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.851766:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:2.0:1784404765.855479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.855551:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707873792 00000100:00100000:3.0:1784404765.855562:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707873792 00000100:00100000:3.0:1784404765.855621:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:3.0:1784404765.855632:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707873792:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404765.855659:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404765.855682:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7299 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404765.855707:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bdb1e, blocks: 0x0 00010000:00010000:3.0:1784404765.855727:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1784404765.855733:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404765.855743:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 6 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.855763:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 6 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.855790:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7a00, rc 0) 00000100:00100000:3.0:1784404765.855879:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707873792:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 221us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.855887:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:2.0:1784404765.865234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.865321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707874048 00000100:00100000:3.0:1784404765.865335:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707874048 00000100:00100000:3.0:1784404765.865404:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 89 00000100:00100000:3.0:1784404765.865417:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707874048:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784404765.865539:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707874048:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 125us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.865547:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 89 00000100:00100000:3.0:1784404765.873131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.873255:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707874176 00000100:00100000:1.0:1784404765.873267:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707874176 00000100:00100000:1.0:1784404765.873360:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:1.0:1784404765.873371:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:11295:x1871083707874176:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404765.873390:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404765.873410:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72a0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.873441:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 7 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.873461:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404765.873466:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404765.873472:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.873510:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 7 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.873523:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 7 pid: 8488 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.873539:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443768000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728919424:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404765.873635:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545683b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404765.884272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.884406:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443768000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728919424:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404765.884443:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.884466:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758e00, rc 0) 00000100:00100000:1.0:1784404765.884531:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:11295:x1871083707874176:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 11162us (11409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.884541:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:0.0:1784404765.884942:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707874304 00000100:00100000:0.0:1784404765.884950:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707874304 00010000:00010000:0.0:1784404765.884985:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 7 pid: 8488 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404765.885105:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:0.0:1784404765.885116:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707874304:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404765.885131:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404765.885152:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 7 pid: 8488 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.885166:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 7 pid: 8488 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.885190:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5d468a9/0x24b3e2e6dcd793a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7299 expref: 7 pid: 8488 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.885204:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404765.885209:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404765.885217:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.885247:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.885281:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404765.885296:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1871083728919552:192.168.202.42@tcp:105: 00000100:00100000:0.0:1784404765.885417:0:6504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784404765.890253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.890353:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1871083728919552:192.168.202.42@tcp:105: 00010000:00010000:0.0:1784404765.890382:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404765.890452:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707874304:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 5338us (6192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.890464:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:1.0:1784404765.892456:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707874432 00000100:00100000:1.0:1784404765.892470:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707874432 00002000:00100000:1.0:1784404765.892520:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9dd4425dce00 x1871083707874432/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:26/0 lens 504/0 e 0 to 0 dl 1784404776 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784404765.892579:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd4425dce00 with x1871083707874432 ext(0->8) 00002000:00010000:1.0:1784404765.892585:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd4425dce00 00000100:00100000:1.0:1784404765.892623:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1784404765.892634:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707874432:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784404765.894021:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707874432:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 1381us (3771us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784404765.894033:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00002000:00100000:1.0:1784404765.894043:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9dd4425dce00 x1871083707874432/t4294967304(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:26/0 lens 504/448 e 0 to 0 dl 1784404776 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784404765.894054:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd4425dce00 with x1871083707874432 ext(0->8) 00002000:00010000:1.0:1784404765.894059:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd4425dce00 00000100:00100000:3.0:1784404765.900494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.905202:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707874560 00000100:00100000:0.0:1784404765.905218:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707874560 00000100:00100000:0.0:1784404765.905294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 90 00000100:00100000:0.0:1784404765.905305:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707874560:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1784404765.905528:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707874560:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 223us (5043us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.905536:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 90 00000100:00100000:3.0:1784404765.915040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.915106:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707874688 00000100:00100000:0.0:1784404765.915117:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707874688 00000100:00100000:0.0:1784404765.915185:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:0.0:1784404765.915195:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57cb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707874688:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784404765.923303:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:0.0:1784404765.923635:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57cb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707874688:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 8435us (8601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.923648:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:3.0:1784404765.925783:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404765.925929:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707874944 00000100:00100000:2.0:1784404765.925940:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707874944 00000100:00100000:2.0:1784404765.926008:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:2.0:1784404765.926019:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707874944:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784404765.926075:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404765.926117:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd793a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7292 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.926145:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:2.0:1784404765.926150:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404765.926180:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.926194:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.926222:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404765.926360:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8447b5b reply state 000000006da1caab transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.926373:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.926379:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:2.0:1784404765.926393:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404765.926396:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404765.926492:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11295:x1871083707874944:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 474us (727us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1784404765.926500:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:0.0:1784404765.935841:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.935931:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707875072 00000100:00100000:3.0:1784404765.935943:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707875072 00000100:00100000:3.0:1784404765.936000:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:3.0:1784404765.936012:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707875072:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784404765.936200:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784404765.936203:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784404765 00002000:00010000:3.0:1784404765.936205:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784404764 00002000:00010000:3.0:1784404765.936206:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1784404766 -> 1784404765 00002000:00010000:3.0:1784404765.936208:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1784404765.937282:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707875072:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 1267us (1445us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784404765.937295:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:1.0:1784404765.943843:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404765.946405:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707875328 00000100:00100000:2.0:1784404765.946583:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707875328 00000100:00100000:2.0:1784404765.946654:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:2.0:1784404765.946665:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11295:x1871083707875328:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784404765.946742:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.946760:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.946777:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.946811:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.946832:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 16 pid: 6519 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404765.946847:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728919680:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404765.946969:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404765.949652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.949695:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728919680:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404765.949721:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.950168:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707875456 00000100:00100000:3.0:1784404765.950175:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707875456 00010000:00010000:3.0:1784404765.950210:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 17 pid: 6519 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.950248:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:3.0:1784404765.950257:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:2403:x1871083707875456:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404765.950272:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404765.950279:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 17 pid: 6519 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.950307:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 17 pid: 6519 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.950330:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79377 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7284 expref: 17 pid: 6519 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.950345:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:3.0:1784404765.950350:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.950360:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.950368:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.950460:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404765.950510:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:2403:x1871083707875456:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 255us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.950522:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00010000:00010000:0.0:1784404765.951022:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.951033:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.951161:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.951170:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.951177:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.951183:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404765.951188:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.951195:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.951218:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:1.0:1784404765.951221:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784404765.951225:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.951231:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd793bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.951331:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707875328:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 4666us (7498us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784404765.951341:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:3.0:1784404765.953485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404765.953640:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707875584 00000100:00100000:2.0:1784404765.953649:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707875584 00000100:00100000:2.0:1784404765.953722:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:2.0:1784404765.953732:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707875584:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784404765.953777:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.953800:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.953810:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404765.953814:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784404765.953819:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.953927:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.953941:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 7 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404765.953978:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728919808:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404765.954061:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478300 going to sleep for 11 seconds 00010000:00010000:0.0:1784404765.956109:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404765.956536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404765.956581:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707875712 00000100:00100000:3.0:1784404765.956588:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707875712 00010000:00010000:3.0:1784404765.956618:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 8 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.956650:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:3.0:1784404765.956657:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707875712:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404765.956682:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404765.956701:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 8 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.956711:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 8 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.956730:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404765.956734:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404765.956740:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.956750:0:10336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.956772:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404765.956833:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707875712:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 176us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.956840:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00010000:00010000:2.0:1784404765.957110:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cd400f1/0x24b3e2e6dcd793af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a0 expref: 7 pid: 8433 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404765.957126:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728919808:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404765.957148:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957158:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957166:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957188:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957196:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957204:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957224:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404765.957228:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957236:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957249:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.957256:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073933a06/0x24b3e2e6dcd793c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404765.957316:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707875584:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 3586us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404765.957322:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1784404765.960177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.960312:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707875968 00000100:00100000:1.0:1784404765.960321:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707875968 00000100:00100000:1.0:1784404765.960397:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 93 00000100:00100000:1.0:1784404765.960407:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:11295:x1871083707875968:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784404765.960486:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.960504:0:9527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.960519:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.960547:0:9527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.960557:0:9527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 15 pid: 6521 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.960580:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728919936:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404765.960654:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545683b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404765.964143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.964225:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728919936:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404765.964228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707876096 00000100:00100000:3.0:1784404765.964237:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707876096 00010000:00010000:1.0:1784404765.964260:0:9527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.964276:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 16 pid: 6521 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.964343:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:3.0:1784404765.964351:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:2403:x1871083707876096:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404765.964379:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404765.964386:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 16 pid: 6521 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.964398:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 16 pid: 6521 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.964420:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549e00/0x24b3e2e6dcd7920b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7229 expref: 16 pid: 6521 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.964436:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.964441:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.964450:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.964457:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.964478:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404765.964502:0:9527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.964509:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.964572:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:2403:x1871083707876096:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 220us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404765.964579:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00010000:00010000:1.0:1784404765.964704:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.964716:0:9527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 15 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.964724:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.964758:0:9527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 15 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.965151:0:9527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 15 pid: 13543 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404765.965166:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728920064:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404765.965307:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545683900 going to sleep for 11 seconds 00000100:00100000:0.0:1784404765.968460:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728920064:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404765.968492:0:9527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404765.969489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.969632:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707876224 00000100:00100000:0.0:1784404765.969640:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707876224 00010000:00010000:0.0:1784404765.969680:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 16 pid: 13543 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404765.969764:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:0.0:1784404765.969784:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:2404:x1871083707876224:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404765.969806:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404765.969814:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 16 pid: 13543 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.969839:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 16 pid: 13543 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.969893:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79385 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed728b expref: 16 pid: 13543 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.969908:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:0.0:1784404765.969913:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.969923:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.969931:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.969955:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404765.970018:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:2404:x1871083707876224:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 235us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.970026:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00010000:00010000:0.0:1784404765.970375:0:9527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.970384:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404765.970585:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1784404765.970708:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1784404765.970744:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1784404765.977652:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728920192:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784404765.977723:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404765.977810:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd442265600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404765.978135:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728920192 00000100:00100000:1.0:1784404765.978145:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728920192 00000100:00100000:1.0:1784404765.978241:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784404765.978251:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9527:x1871083728920192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784404765.978357:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9527:x1871083728920192:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404765.978365:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784404765.978459:0:9527:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1784404765.978466:0:9527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd570592d80, transno 4294967302 00000100:00100000:3.0:1784404765.978479:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728920192:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1784404765.978627:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1784404765.978699:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728920320:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784404765.978731:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404765.980334:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404765.980485:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728920320 00000100:00100000:2.0:1784404765.980493:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728920320 00000100:00100000:2.0:1784404765.980536:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784404765.980545:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9527:x1871083728920320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784404765.980706:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9527:x1871083728920320:12345-0@lo:1000:mdt00_003.0 Request processed in 161us (1973us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784404765.980714:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784404765.980809:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728920320:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784404765.980883:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980895:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980904:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980910:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.980915:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980923:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980942:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:3.0:1784404765.980946:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404765.980951:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980958:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd793d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980988:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.980995:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981007:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981012:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.981015:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981022:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981031:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.981033:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404765.981036:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981041:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79300 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981067:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981093:0:9527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981103:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981147:0:9527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.981172:0:9527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 18 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.981186:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728920448:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404765.981257:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404765.984532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404765.984608:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707876352 00000100:00100000:0.0:1784404765.984617:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707876352 00010000:00010000:0.0:1784404765.984654:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 19 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.984669:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728920448:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404765.984695:0:9527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404765.984699:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:0.0:1784404765.984709:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:2403:x1871083707876352:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404765.984725:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404765.984733:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 19 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.984745:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 19 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.984770:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd7931c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed726f expref: 19 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.984789:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:0.0:1784404765.984794:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.984816:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.984832:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404765.984882:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404765.984886:0:9527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984893:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984904:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984909:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984915:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984920:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.984924:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984931:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404765.984932:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2403:x1871083707876352:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 224us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404765.984939:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00010000:00010000:3.0:1784404765.984946:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.984948:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404765.984952:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984957:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793d9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984968:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984975:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984980:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984984:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404765.984987:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.984993:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.985000:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47a00) 00010000:00010000:3.0:1784404765.985002:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784404765.985005:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404765.985010:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd793cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404765.985194:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:11295:x1871083707875968:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 24788us (25027us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1784404765.985203:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 93 00000020:00080000:3.0:1784404765.985207:0:9527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784404765.985252:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784404765.985256:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784404765.985273:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784404765.985280:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784404765.987626:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404765.987690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707876608 00000100:00100000:1.0:1784404765.987699:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707876608 00000100:00100000:1.0:1784404765.987750:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784404765.987760:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:11295:x1871083707876608:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784404765.988051:0:6522:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784404765.988095:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1784404765.988128:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.988144:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.988155:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.988164:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.988171:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.988177:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404765.988210:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784404765.988288:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11295:x1871083707876608:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 529us (667us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1784404765.988296:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000020:00080000:1.0:1784404765.988300:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784404765.988518:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404765.988525:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.988533:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404765.988536:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.988544:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.988556:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:2.0:1784404765.988560:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784404765.988564:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.988575:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd793e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404765.988589:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404765.988591:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404765.988592:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784404766.332398:0:14205:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784404766.332408:0:14205:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784404766.333497:0:14205:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784404766.333511:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784404766.464193:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404766.465568:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707876864 00000100:00100000:0.0:1784404766.465580:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707876864 00000100:00100000:0.0:1784404766.465651:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:0.0:1784404766.465660:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11305:x1871083707876864:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404766.465682:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404766.465700:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd793e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72a7 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.465810:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd793ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.465837:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd793ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.465883:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd793ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404766.465898:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784404766.466028:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd793e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a7 expref: 22 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.466046:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd793ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a7 expref: 21 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.466054:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404766.466057:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404766.466060:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ac00, rc 0) 00000100:00100000:0.0:1784404766.466143:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11305:x1871083707876864:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 483us (1970us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1784404766.466150:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:1.0:1784404766.468752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404766.468894:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707876992 00000100:00100000:3.0:1784404766.468904:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707876992 00000100:00100000:3.0:1784404766.468947:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 95 00000100:00100000:3.0:1784404766.468955:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11305:x1871083707876992:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:3.0:1784404766.469053:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469086:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469104:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469123:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469128:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469141:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469237:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469243:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469261:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404766.469302:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469313:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469317:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469322:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469326:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404766.469329:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469333:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469341:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:3.0:1784404766.469343:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404766.469346:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469350:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd793fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469360:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469378:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469383:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469386:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404766.469387:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469391:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469396:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd544e47900) 00010000:00010000:3.0:1784404766.469397:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404766.469399:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469403:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79403 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469413:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469416:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469419:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469422:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404766.469427:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469431:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469435:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd544e47100) 00010000:00010000:3.0:1784404766.469437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404766.469438:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.469441:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7940a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404766.469506:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11305:x1871083707876992:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 552us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404766.469512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 95 00000100:00100000:2.0:1784404766.512728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404766.512833:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707877248 00000100:00100000:1.0:1784404766.512844:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707877248 00000100:00100000:1.0:1784404766.512929:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:1.0:1784404766.512941:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11308:x1871083707877248:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404766.512980:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404766.513002:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd79411 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72ae expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513099:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513114:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513124:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513144:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513149:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513165:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513296:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513304:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513312:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404766.513322:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1784404766.513420:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513428:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513434:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513440:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404766.513444:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513451:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513465:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404766.513468:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404766.513480:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513487:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79418 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513501:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513507:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513512:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513516:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404766.513518:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513523:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513530:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd573869000) 00010000:00010000:1.0:1784404766.513532:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404766.513534:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513539:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758600/0x24b3e2e6dcd7941f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513577:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd79411 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 24 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513604:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 23 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.513610:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:1.0:1784404766.513612:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404766.513614:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759e00, rc 0) 00000100:00100000:1.0:1784404766.513676:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:11308:x1871083707877248:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 737us (957us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1784404766.513684:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:1.0:1784404766.518540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404766.518615:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707877376 00000100:00100000:3.0:1784404766.518624:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707877376 00000100:00100000:3.0:1784404766.518689:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:3.0:1784404766.518700:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:11308:x1871083707877376:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:3.0:1784404766.518776:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518794:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518808:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518880:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518902:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518909:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518915:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404766.518920:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518927:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518939:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:3.0:1784404766.518942:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404766.518947:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.518953:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404766.519044:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:11308:x1871083707877376:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 346us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404766.519052:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:0.0:1784404766.525677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.525756:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707877632 00000100:00100000:2.0:1784404766.525764:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707877632 00000100:00100000:2.0:1784404766.525824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784404766.525835:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:11308:x1871083707877632:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404766.526103:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:11308:x1871083707877632:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 268us (436us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1784404766.526116:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1784404766.559557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404766.559600:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707877888 00000100:00100000:0.0:1784404766.559612:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707877888 00000100:00100000:0.0:1784404766.559667:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:0.0:1784404766.559678:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:10834:x1871083707877888:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404766.559711:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404766.559737:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7943b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.559892:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.559909:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 25 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.559918:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.559953:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 25 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.561531:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 25 pid: 9527 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404766.561552:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728920576:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404766.561668:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570673f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404766.567728:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728920576:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404766.567762:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404766.568327:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404766.568414:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707878016 00000100:00100000:1.0:1784404766.568423:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707878016 00010000:00010000:1.0:1784404766.568464:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 26 pid: 9527 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404766.568506:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:1.0:1784404766.568518:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:2403:x1871083707878016:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404766.568535:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404766.568543:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 26 pid: 9527 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.568556:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 26 pid: 9527 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.568586:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79426 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ae expref: 26 pid: 9527 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.568619:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:1.0:1784404766.568626:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.568636:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.568645:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.568675:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404766.568729:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:2403:x1871083707878016:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 213us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.568737:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00010000:00010000:3.0:1784404766.572272:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.572292:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404766.572317:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784404766.572485:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7943b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.572507:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.572517:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:3.0:1784404766.572520:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784404766.572524:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a000, rc 0) 00000100:00100000:3.0:1784404766.572602:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:10834:x1871083707877888:12345-192.168.202.42@tcp:101:bash.0 Request processed in 12925us (13058us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1784404766.572611:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:0.0:1784404766.577340:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404766.577472:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707878144 00000100:00100000:1.0:1784404766.577480:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707878144 00000100:00100000:1.0:1784404766.577528:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00100000:1.0:1784404766.577539:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:10834:x1871083707878144:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404766.577565:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404766.577585:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79450 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72bc expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.577611:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79457 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.577622:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.577631:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.577752:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72bc expref: 27 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.577776:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72bc expref: 26 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.577782:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:1.0:1784404766.577785:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404766.577788:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758200, rc 0) 00000100:00100000:1.0:1784404766.577842:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:10834:x1871083707878144:12345-192.168.202.42@tcp:101:bash.0 Request processed in 305us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.577870:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00100000:1.0:1784404766.583037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404766.583091:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707878400 00000100:00100000:3.0:1784404766.583104:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707878400 00000100:00100000:3.0:1784404766.583168:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 100 00000100:00100000:3.0:1784404766.583235:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:10834:x1871083707878400:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:3.0:1784404766.583471:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.583490:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.583502:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784404766.583546:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1784404766.583569:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfa1b57d reply state 00000000c80b8104 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.583702:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.583726:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:3.0:1784404766.583729:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404766.583732:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784404766.583771:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1784404766.583900:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:10834:x1871083707878400:12345-192.168.202.42@tcp:36:bash.0 Request processed in 667us (872us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1784404766.583908:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 100 00000020:00080000:3.0:1784404766.583914:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1784404766.586146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404766.586807:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707878528 00000100:00100000:3.0:1784404766.586818:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707878528 00000100:00100000:3.0:1784404766.586911:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:3.0:1784404766.586922:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:10834:x1871083707878528:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404766.586944:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404766.586965:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79465 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.587022:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72c3 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.587037:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72c3 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.587057:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:3.0:1784404766.587060:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404766.587064:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6e00, rc 0) 00000100:00100000:3.0:1784404766.587138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+31:10834:x1871083707878528:12345-192.168.202.42@tcp:101:bash.0 Request processed in 218us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404766.587159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:2.0:1784404766.592732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404766.593059:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707878656 00000100:00100000:1.0:1784404766.593071:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707878656 00000100:00100000:1.0:1784404766.593154:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:1.0:1784404766.593164:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:10834:x1871083707878656:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404766.593184:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404766.593206:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72ca expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784404766.593235:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a5bdb1d, atime: 0x6a5bdb1c, ctime: 0x6a5bdb1d, blocks: 0x8 00010000:00010000:1.0:1784404766.593259:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1784404766.593265:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404766.593274:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.593314:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404766.593327:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758800, rc 0) 00000100:00100000:1.0:1784404766.593825:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:10834:x1871083707878656:12345-192.168.202.42@tcp:101:bash.0 Request processed in 662us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.593834:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:2.0:1784404766.595784:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728920704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404766.595874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404766.595924:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728920832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404766.595953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404766.595985:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728920704 00000100:00100000:2.0:1784404766.595993:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728920704 00000100:00100000:2.0:1784404766.596047:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784404766.596057:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728920704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404766.596092:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1784404766.596285:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728920832 00000100:00100000:0.0:1784404766.596289:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728920832 00000100:00100000:0.0:1784404766.596312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784404766.596319:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1871083728920832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404766.596343:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404766.596376:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1871083728920832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404766.596383:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784404766.596404:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728920960:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.596434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404766.596464:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728921472:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.596494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404766.596513:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728921984:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.596538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404766.596557:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784404766.596563:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728921344:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.596585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404766.596600:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728921856:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.596621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404766.596638:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728922368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404766.596657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404766.596683:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921856 00000100:00100000:0.0:1784404766.596687:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921856 00000100:00100000:0.0:1784404766.596717:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784404766.596724:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728921856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404766.596765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728920960 00000100:00100000:3.0:1784404766.596770:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728920960 00000100:00100000:3.0:1784404766.596801:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1784404766.596808:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728920960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404766.596842:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728920960:12345-0@lo:400:kworker.0 Request processed in 35us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404766.596865:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1784404766.596981:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921984 00000100:00100000:1.0:1784404766.596985:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921984 00000100:00100000:1.0:1784404766.597019:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921344 00000100:00100000:1.0:1784404766.597022:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921344 00000100:00100000:1.0:1784404766.597047:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784404766.597054:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728921984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404766.597100:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728921984:12345-0@lo:400:kworker.0 Request processed in 47us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.597107:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784404766.597121:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784404766.597127:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728921344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404766.597153:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728921344:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.597159:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784404766.597414:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728922368 00000100:00100000:1.0:1784404766.597418:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728922368 00000100:00100000:1.0:1784404766.597438:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784404766.597443:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728922368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404766.597468:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784404766.597498:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083728922368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.597504:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784404766.597548:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728920832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404766.597571:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404766.597590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728922496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404766.597620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404766.597775:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728920704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1717us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404766.597784:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784404766.597808:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728921856:12345-0@lo:400:kworker.0 Request processed in 39us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404766.597824:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784404766.597874:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728921344:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.597888:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728921856:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.597901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728922368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404766.597910:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728920960:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.597920:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728921984:0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.597928:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728922496 00000100:00100000:2.0:1784404766.597931:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728922496 00000100:00100000:3.0:1784404766.598105:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784404766.598177:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728922496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404766.598193:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1784404766.598238:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728922496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404766.598243:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784404766.598324:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728922496:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784404766.598551:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404766.598558:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404766.598561:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404766.598885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404766.598947:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707878784 00000100:00100000:3.0:1784404766.598951:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707878784 00002000:00010000:3.0:1784404766.598979:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1784404766.598983:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443769f80 with x1871083707878784 ext(0->18446744073709551615) 00002000:00010000:3.0:1784404766.598997:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443769f80. 00000100:00100000:3.0:1784404766.599026:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1784404766.599035:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707878784:12345-192.168.202.42@tcp:10:bash.0 00000100:00100000:2.0:1784404766.599312:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921472 00000100:00100000:2.0:1784404766.599317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921472 00000100:00100000:2.0:1784404766.599353:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784404766.599360:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1784404766.599361:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728921472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404766.599368:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1784404766.599427:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728921472:12345-0@lo:400:kworker.0 Request processed in 67us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404766.599434:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784404766.599466:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728921088:0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.599507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404766.599547:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728921600:0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.599569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404766.599588:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728922112:0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.599610:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404766.599700:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784404766.599700:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921088 00000100:00100000:1.0:1784404766.599704:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921088 00000100:00100000:2.0:1784404766.599709:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728921216:0@lo:400:kworker.0 00000100:00100000:1.0:1784404766.599733:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921600 00000100:00100000:2.0:1784404766.599736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404766.599736:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921600 00000100:00100000:2.0:1784404766.599754:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728921728:0@lo:400:kworker.0 00000100:00100000:1.0:1784404766.599770:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728922112 00000100:00100000:1.0:1784404766.599773:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728922112 00000100:00100000:1.0:1784404766.599795:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784404766.599802:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728921088:12345-0@lo:400:kworker.0 00002000:00010000:3.0:1784404766.600210:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784404766.600214:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1784404765 -> 1784404767 00002000:00010000:3.0:1784404766.600216:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1784404764 -> 1784404764 00002000:00010000:3.0:1784404766.600219:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1784404765 -> 1784404767 00002000:00010000:3.0:1784404766.600221:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1784404766.603805:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728921088:12345-0@lo:400:kworker.0 Request processed in 3987us (4280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.603825:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1784404766.603827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404766.603882:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921728 00000100:00100000:1.0:1784404766.603890:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921728 00000100:00100000:2.0:1784404766.603899:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728922240:0@lo:400:kworker.0 00000100:00100000:1.0:1784404766.603936:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1784404766.603945:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728921600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.603948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404766.604127:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728921088:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.604130:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728922240 00000100:00100000:0.0:1784404766.604134:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728922240 00000100:00100000:0.0:1784404766.604168:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784404766.604175:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728922240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.604211:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728922240:12345-0@lo:400:kworker.0 Request processed in 37us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404766.604217:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784404766.604295:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728922240:0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.604322:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784404766.604330:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728922112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.604498:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728922112:12345-0@lo:400:kworker.0 Request processed in 168us (4885us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.604498:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728921600:12345-0@lo:400:kworker.0 Request processed in 553us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.604505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784404766.604508:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784404766.604519:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784404766.604526:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728921728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.604535:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728921216 00000100:00100000:2.0:1784404766.604539:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728921216 00000100:00100000:1.0:1784404766.604555:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728921728:12345-0@lo:400:kworker.0 Request processed in 31us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.604561:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784404766.604571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784404766.604577:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728921216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404766.604614:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728921216:12345-0@lo:400:kworker.0 Request processed in 36us (4876us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404766.604620:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1784404766.604722:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404766.604727:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404766.604738:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707878784:12345-192.168.202.42@tcp:10:bash.0 Request processed in 5700us (5849us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784404766.604748:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00002000:00010000:3.0:1784404766.604753:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1784404766.604763:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443769f80 with x1871083707878784 ext(0->18446744073709551615) 00002000:00010000:3.0:1784404766.604777:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443769f80. 00000100:00100000:2.0:1784404766.604908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728920704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404766.604939:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728921472:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.605503:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728921600:0@lo:400:kworker.0 00010000:00080000:0.0:1784404766.605521:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c8c000 x1871083728922112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404766.605532:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728922112:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.605566:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728921216:0@lo:400:kworker.0 00010000:00080000:0.0:1784404766.605649:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c8ed80 x1871083728921728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404766.605659:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728921728:0@lo:400:kworker.0 00000100:00100000:0.0:1784404766.656459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.656537:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707878912 00000100:00100000:2.0:1784404766.656546:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707878912 00000100:00100000:2.0:1784404766.656639:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:2.0:1784404766.656649:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+31:11322:x1871083707878912:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:2.0:1784404766.656724:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656738:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656748:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656762:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656768:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656774:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656905:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656914:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656931:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404766.656980:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656992:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.656999:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657005:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657013:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.657018:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657026:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657039:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404766.657041:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.657045:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657050:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79473 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657060:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657068:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657072:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657087:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.657090:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657097:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657105:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:2.0:1784404766.657107:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.657110:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657115:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7947a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657140:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657146:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657151:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657157:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.657166:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657177:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657185:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:2.0:1784404766.657187:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.657190:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.657196:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79481 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404766.657282:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+31:11322:x1871083707878912:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 632us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404766.657290:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:1.0:1784404766.688483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.689085:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707879168 00000100:00100000:2.0:1784404766.689097:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707879168 00000100:00100000:2.0:1784404766.689223:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 103 00000100:00100000:2.0:1784404766.689236:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+31:11325:x1871083707879168:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404766.689257:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404766.689275:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79488 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72d1 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689340:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689351:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689376:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689386:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689391:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689395:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689500:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7949d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689507:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7949d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.689511:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7949d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404766.689519:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784404766.689587:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691733:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691751:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691756:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541390600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.691777:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691785:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691802:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404766.691805:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.691810:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691818:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541390600/0x24b3e2e6dcd7948f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691837:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691843:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691884:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691890:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd541391200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.691893:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691898:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691907:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:2.0:1784404766.691909:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.691918:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.691924:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391200/0x24b3e2e6dcd79496 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.693745:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391800/0x24b3e2e6dcd79488 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72d1 expref: 34 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.693769:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7949d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72d1 expref: 33 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.693777:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:2.0:1784404766.693780:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784404766.693783:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516ec00, rc 0) 00000100:00100000:2.0:1784404766.693880:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+33:11325:x1871083707879168:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 4645us (5406us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1784404766.693889:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 103 00000100:00100000:3.0:1784404766.697949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.698816:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707879296 00000100:00100000:2.0:1784404766.698827:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707879296 00000100:00100000:2.0:1784404766.698901:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 104 00000100:00100000:2.0:1784404766.698912:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+33:11325:x1871083707879296:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1784404766.699053:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.699071:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.699094:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.699222:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.699237:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 33 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404766.699254:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728922624:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404766.699355:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404766.702609:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.702816:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728922624:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404766.702925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707879552 00000100:00100000:1.0:1784404766.702934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707879552 00000100:00100000:1.0:1784404766.703005:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1784404766.703015:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:6171:x1871083707879552:12345-192.168.202.42@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1784404766.703263:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404766.703382:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:6171:x1871083707879552:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 367us (783us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1784404766.703390:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:0.0:1784404766.705767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.705920:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707879680 00000100:00100000:2.0:1784404766.705928:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707879680 00010000:00010000:2.0:1784404766.706033:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 35 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404766.706124:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:2.0:1784404766.706134:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:2404:x1871083707879680:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404766.706149:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404766.706156:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 35 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.706171:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 35 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.706214:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79442 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72b5 expref: 35 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.706231:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:2.0:1784404766.706236:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.706247:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.706254:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.706292:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404766.706352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:2404:x1871083707879680:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 219us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404766.706360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00010000:00010000:3.0:1784404766.706423:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706432:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706471:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706479:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706486:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706492:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404766.706497:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706505:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706515:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:3.0:1784404766.706518:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404766.706522:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.706529:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd794ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404766.706574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+33:11325:x1871083707879296:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 7664us (8634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404766.706583:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 104 00000100:00100000:2.0:1784404766.711988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404766.712445:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707879936 00000100:00100000:0.0:1784404766.712456:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707879936 00000100:00100000:0.0:1784404766.712520:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:0.0:1784404766.712531:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+33:11325:x1871083707879936:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1784404766.712881:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:11325:x1871083707879936:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 350us (905us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1784404766.712889:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1784404766.819333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.819435:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707880192 00000100:00100000:2.0:1784404766.819445:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707880192 00000100:00100000:2.0:1784404766.819505:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 105 00000100:00100000:2.0:1784404766.819517:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:11336:x1871083707880192:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1784404766.819543:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404766.819563:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72d8 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819661:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819690:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819701:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819717:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819725:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819736:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819910:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd794c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819919:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd794c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.819926:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd794c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404766.819936:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1784404766.820014:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820022:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820028:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820041:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ee00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.820045:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820053:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820065:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404766.820068:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.820083:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820090:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820105:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820111:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820117:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820122:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.820125:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820131:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820150:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:2.0:1784404766.820153:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.820156:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820162:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820206:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72d8 expref: 37 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820220:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd794c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72d8 expref: 36 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.820228:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:2.0:1784404766.820230:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404766.820233:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fa00, rc 0) 00000100:00100000:2.0:1784404766.820554:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+36:11336:x1871083707880192:12345-192.168.202.42@tcp:101:cat.0 Request processed in 1039us (1232us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1784404766.820612:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 105 00000100:00100000:2.0:1784404766.832645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404766.832767:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707880448 00000100:00100000:1.0:1784404766.832778:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707880448 00000100:00100000:1.0:1784404766.832842:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784404766.832877:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+36:11336:x1871083707880448:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:1.0:1784404766.833563:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:11336:x1871083707880448:12345-192.168.202.42@tcp:35:cat.0 Request processed in 708us (924us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1784404766.833572:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784404766.854587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.854699:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707880704 00000100:00100000:2.0:1784404766.854710:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707880704 00000100:00100000:2.0:1784404766.854782:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 106 00000100:00100000:2.0:1784404766.854790:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:11337:x1871083707880704:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:2.0:1784404766.854848:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1784404766.854905:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79465 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72c3 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.854934:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd794c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72d8 expref: 36 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.854945:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7949d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72d1 expref: 35 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.854956:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd79457 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72bc expref: 34 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.854965:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:2.0:1784404766.854969:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404766.854992:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855005:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855014:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855028:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855035:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855041:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855143:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855152:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855159:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404766.855380:0:13543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1784404766.855391:0:13543:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384739539029ns, next at 385739536116ns, rc = 0 00010000:00010000:2.0:1784404766.855442:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855452:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855459:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855466:0:13543:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855472:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855478:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855619:0:13543:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404766.855648:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855662:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855668:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855674:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ee00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.855678:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855684:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855691:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:2.0:1784404766.855693:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784404766.855696:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855699:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855710:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855713:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855718:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855721:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.855727:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855731:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855735:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404766.855736:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.855738:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855741:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404766.855747:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f777106 reply state 00000000c536567b transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855755:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.855758:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:2.0:1784404766.855759:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404766.855761:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404766.855824:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:11337:x1871083707880704:12345-192.168.202.42@tcp:36:rm.0 Request processed in 1034us (1247us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1784404766.855832:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 106 00010000:00010000:3.0:1784404766.855939:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404766.855946:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.855952:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404766.855955:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.855961:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.855969:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:3.0:1784404766.855972:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784404766.855975:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.855980:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd794ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404766.855989:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404766.855991:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404766.855993:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404766.892446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.892535:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707880960 00000100:00100000:2.0:1784404766.892548:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707880960 00000100:00100000:2.0:1784404766.892612:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:2.0:1784404766.892623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:11343:x1871083707880960:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784404766.892646:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404766.892680:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.892781:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.892796:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.892808:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.892829:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.892836:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.892843:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784404766.893259:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784404766.893399:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893408:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893415:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893449:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893467:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893474:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893480:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ee00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404766.893485:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893492:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893504:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404766.893507:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404766.893512:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893518:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd794f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404766.893532:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000993ea047 reply state 0000000071b9ee4e transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893544:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893550:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:2.0:1784404766.893553:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404766.893555:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784404766.893585:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd794f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893608:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.893616:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd443416f00) 00010000:00010000:2.0:1784404766.893618:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404766.893621:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fa00, rc 0) 00000100:00100000:2.0:1784404766.893694:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:11343:x1871083707880960:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1071us (1260us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1784404766.893702:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 107 00000100:00100000:0.0:1784404766.904948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404766.905010:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707881088 00000100:00100000:2.0:1784404766.905021:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707881088 00000100:00100000:2.0:1784404766.905389:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:2.0:1784404766.905402:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707881088:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784404766.905420:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404766.905442:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72e6 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784404766.905469:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784404766.905495:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1784404766.905499:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404766.905507:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 8 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.905524:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 8 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.905557:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e400, rc 0) 00000100:00100000:2.0:1784404766.905635:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2402:x1871083707881088:12345-192.168.202.42@tcp:101:bash.0 Request processed in 236us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404766.905642:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00080000:0.0:1784404766.906311:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404766.908921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404766.910046:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707881216 00000100:00100000:0.0:1784404766.910058:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707881216 00000100:00100000:0.0:1784404766.910145:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:0.0:1784404766.910157:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:11343:x1871083707881216:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404766.910179:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404766.910202:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72ed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.910238:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 9 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.910270:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404766.910274:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404766.910281:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.910362:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 9 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.910372:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 9 pid: 8488 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404766.910383:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574f1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1871083728922752:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404766.910516:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5706736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404766.914671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404766.914701:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574f1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1871083728922752:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404766.914733:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404766.914753:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151bc00, rc 0) 00000100:00100000:2.0:1784404766.914953:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707881344 00000100:00100000:2.0:1784404766.914961:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707881344 00010000:00010000:2.0:1784404766.914997:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 10 pid: 8488 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404766.915096:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:11343:x1871083707881216:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4657us (5900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404766.915104:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:2.0:1784404766.915162:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:2.0:1784404766.915172:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2404:x1871083707881344:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404766.915186:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404766.915210:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 9 pid: 8488 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.915223:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 9 pid: 8488 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.915250:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd79514 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72e6 expref: 9 pid: 8488 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.915264:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404766.915268:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404766.915275:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.915300:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404766.915335:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404766.915348:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1871083728922880:192.168.202.42@tcp:105: 00000100:00100000:2.0:1784404766.915402:0:6504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478000 going to sleep for 11 seconds 00000100:00100000:1.0:1784404766.919506:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1871083728922880:192.168.202.42@tcp:105: 00010000:00010000:1.0:1784404766.919538:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404766.919648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404766.919735:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707881600 00000100:00100000:0.0:1784404766.919743:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707881600 00000100:00100000:1.0:1784404766.919745:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707881344:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 4574us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404766.919755:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:0.0:1784404766.919803:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1784404766.919892:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:11343:x1871083707881600:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:0.0:1784404766.921565:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:11343:x1871083707881600:12345-192.168.202.42@tcp:35:bash.0 Request processed in 1713us (1906us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1784404766.921577:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00010000:00010000:0.0:1784404766.979954:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404767.076010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.076099:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707881728 00000100:00100000:2.0:1784404767.076112:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707881728 00000100:00100000:2.0:1784404767.076214:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 108 00000100:00100000:2.0:1784404767.076225:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:11359:x1871083707881728:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404767.076254:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404767.076276:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72f4 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.076352:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79529 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.076369:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.076381:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404767.076428:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784404767.076445:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404767.076469:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.076496:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72f4 expref: 41 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.076515:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72f4 expref: 40 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.076525:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404767.076528:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784404767.076534:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f600, rc 0) 00000100:00080000:0.0:1784404767.076746:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404767.076778:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:11359:x1871083707881728:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 554us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404767.076785:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 108 00000100:00100000:3.0:1784404767.080586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.080672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707881984 00000100:00100000:0.0:1784404767.080682:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707881984 00000100:00100000:0.0:1784404767.080738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 109 00000100:00100000:0.0:1784404767.080749:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:11359:x1871083707881984:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404767.080782:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404767.080803:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79530 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed72fb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.080943:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79537 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.080959:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.080983:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79537 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404767.080995:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784404767.081114:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79530 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72fb expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.081145:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79537 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72fb expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.081171:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd443416f00) 00010000:00010000:0.0:1784404767.081174:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404767.081177:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a800, rc 0) 00000100:00100000:0.0:1784404767.081744:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+42:11359:x1871083707881984:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 994us (1164us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1784404767.081753:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 109 00000100:00100000:1.0:1784404767.085026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404767.085081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.085089:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707882368 00000100:00100000:0.0:1784404767.085098:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707882368 00000100:00100000:0.0:1784404767.085224:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 110 00000100:00100000:0.0:1784404767.085234:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+42:11359:x1871083707882368:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404767.085260:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404767.085280:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79545 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7302 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404767.085345:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707882112 00000100:00100000:2.0:1784404767.085350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707882112 00000100:00100000:2.0:1784404767.085385:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1784404767.085393:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:2403:x1871083707882112:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404767.085403:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404767.085423:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79537 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72fb expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.085438:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd443416f00) 00010000:00010000:2.0:1784404767.085442:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404767.085466:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7954c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.085479:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7954c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404767.085489:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:2403:x1871083707882112:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 97us (418us total) trans 0 rc 0/0 00010000:00010000:0.0:1784404767.085490:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7954c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404767.085502:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:2.0:1784404767.085511:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00010000:00010000:0.0:1784404767.085600:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79545 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7302 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.085627:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7954c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7302 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.085634:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd443416f00) 00010000:00010000:0.0:1784404767.085637:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784404767.085639:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:0.0:1784404767.085664:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:11359:x1871083707882368:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 432us (650us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1784404767.085670:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 110 00000100:00100000:1.0:1784404767.090757:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.091473:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707882496 00000100:00100000:2.0:1784404767.091486:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707882496 00000100:00100000:2.0:1784404767.091603:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:2.0:1784404767.091615:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2402:x1871083707882496:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:2.0:1784404767.091659:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.091680:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.091690:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404767.091694:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784404767.091698:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.091734:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.091747:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 8 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404767.091774:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8488:1871083728923008:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404767.091898:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404767.094715:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8488:1871083728923008:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404767.094753:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404767.097491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.097802:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707882624 00000100:00100000:2.0:1784404767.097828:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707882624 00002000:00100000:2.0:1784404767.097933:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9dd44352a680 x1871083707882624/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:28/0 lens 504/0 e 0 to 0 dl 1784404778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784404767.097944:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd44352a680 with x1871083707882624 ext(0->8) 00010000:00010000:2.0:1784404767.097953:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 9 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.097969:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 9 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784404767.097977:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd44352a680 00000100:00100000:2.0:1784404767.098033:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:2.0:1784404767.098042:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707882624:12345-192.168.202.42@tcp:4:lfs.0 00000100:00100000:2.0:1784404767.099020:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44352a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:2403:x1871083707882624:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 974us (1533us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784404767.099029:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00002000:00100000:2.0:1784404767.099036:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9dd44352a680 x1871083707882624/t4294967303(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:28/0 lens 504/448 e 0 to 0 dl 1784404778 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784404767.099046:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd44352a680 with x1871083707882624 ext(0->8) 00010000:00010000:2.0:1784404767.099052:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 11 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.099064:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 11 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784404767.099092:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd44352a680 00000100:00100000:2.0:1784404767.103123:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404767.103214:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707882752 00000100:00100000:3.0:1784404767.103240:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707882752 00010000:00010000:3.0:1784404767.103281:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 11 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404767.103326:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:3.0:1784404767.103334:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:2401:x1871083707882752:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404767.103348:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784404767.103363:0:10336:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784404767.103366:0:10336:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784404767 00002000:00010000:3.0:1784404767.103367:0:10336:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784404767 00002000:00010000:3.0:1784404767.103369:0:10336:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1784404767 00002000:00010000:3.0:1784404767.103370:0:10336:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784404767.103375:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 11 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.103384:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 11 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.103405:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000779b0292/0x24b3e2e6dcd7951b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ed expref: 11 pid: 8434 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.103421:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404767.103424:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404767.103429:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.103436:0:10336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.103472:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404767.103521:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2401:x1871083707882752:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 188us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404767.103526:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00010000:00010000:0.0:1784404767.103681:0:8488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103692:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103711:0:8488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103717:0:8488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103732:0:8488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103736:0:8488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404767.103740:0:8488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103745:0:8488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103754:0:8488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.103769:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244fb8dc/0x24b3e2e6dcd7955a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404767.103813:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2402:x1871083707882496:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 12203us (13070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404767.103819:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:3.0:1784404767.106500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404767.106624:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707883008 00000100:00100000:1.0:1784404767.106633:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707883008 00000100:00100000:1.0:1784404767.106690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:1.0:1784404767.106702:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:11359:x1871083707883008:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:1.0:1784404767.106768:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7954c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7302 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784404767.107000:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1784404767.107035:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1784404767.107709:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1784404767.107754:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.107770:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.107780:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.107831:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.107846:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 47 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404767.107903:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728923136:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404767.108093:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5456830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404767.110617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404767.110724:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728923136:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404767.110749:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404767.111177:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707883136 00000100:00100000:0.0:1784404767.111186:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707883136 00010000:00010000:0.0:1784404767.111224:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 48 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404767.111406:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:0.0:1784404767.111429:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+48:2404:x1871083707883136:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404767.111445:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404767.111452:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 48 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.111465:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 48 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.111487:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79506 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72df expref: 48 pid: 6520 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.111502:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd443416f00) 00010000:00010000:0.0:1784404767.111507:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.111516:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.111524:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.111553:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404767.111607:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+47:2404:x1871083707883136:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 179us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404767.111615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00010000:00010000:1.0:1784404767.111664:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.111672:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784404767.111784:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1784404767.111932:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1784404767.112035:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728923264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404767.112124:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404767.112152:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712900 going to sleep for 11 seconds 00000100:00100000:1.0:1784404767.112170:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728923264 00000100:00100000:1.0:1784404767.112174:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728923264 00000100:00080000:1.0:1784404767.112198:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404767.112232:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784404767.112240:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6522:x1871083728923264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404767.112597:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6522:x1871083728923264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 357us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404767.112605:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784404767.114258:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728923264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784404767.114494:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1784404767.114567:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728923392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404767.114619:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404767.114691:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5513890c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404767.114728:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728923392 00000100:00100000:2.0:1784404767.114734:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728923392 00000100:00100000:2.0:1784404767.115144:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784404767.115156:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1871083728923392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784404767.115328:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6522:x1871083728923392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 165us (699us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784404767.115336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784404767.115402:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728923392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784404767.115451:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1784404767.115487:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.115498:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.115506:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.115512:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404767.115517:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.115526:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.115543:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd443416f00) 00010000:00010000:1.0:1784404767.115546:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784404767.115568:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.115575:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79561 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784404767.115681:0:6522:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784404767.115753:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1784404767.115778:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384999925650ns, next at 385999923288ns, rc = 0 00000001:00080000:1.0:1784404767.115785:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1784404767.115806:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd443416f00) 00010000:00010000:1.0:1784404767.115809:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784404767.115815:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7954c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7302 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404767.115950:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:11359:x1871083707883008:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 9250us (9457us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1784404767.115958:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000020:00080000:1.0:1784404767.115961:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784404767.123170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404767.123313:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707883264 00000100:00100000:1.0:1784404767.123397:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707883264 00000100:00100000:1.0:1784404767.123499:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 111 00000100:00100000:1.0:1784404767.123509:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:11359:x1871083707883264:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404767.123535:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404767.123559:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79568 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7309 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.123632:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79568 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7309 expref: 51 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.123667:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79568 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7309 expref: 51 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.123686:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:1.0:1784404767.123689:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404767.123692:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759800, rc 0) 00000100:00100000:1.0:1784404767.123849:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+51:11359:x1871083707883264:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 250us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404767.123875:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 111 00000100:00100000:3.0:1784404767.126836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.127088:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707883520 00000100:00100000:0.0:1784404767.127098:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707883520 00000100:00100000:0.0:1784404767.127166:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1784404767.127176:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+51:11359:x1871083707883520:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1784404767.127447:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11359:x1871083707883520:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 272us (620us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1784404767.127456:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:3.0:1784404767.229126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.229248:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707883648 00000100:00100000:0.0:1784404767.229260:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707883648 00000100:00100000:0.0:1784404767.229335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 112 00000100:00100000:0.0:1784404767.229347:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11369:x1871083707883648:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:0.0:1784404767.229440:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229460:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229473:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229485:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229493:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229500:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229578:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229588:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229615:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784404767.229666:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229678:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229685:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229694:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229701:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404767.229707:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229716:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229729:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404767.229732:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404767.229737:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229744:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7956f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229772:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229789:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229796:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229801:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ba00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404767.229804:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229811:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229819:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:0.0:1784404767.229822:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404767.229825:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229831:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79576 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229840:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229846:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229921:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229926:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404767.229936:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229942:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229950:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404767.229953:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404767.229956:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.229961:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7957d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404767.230039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11369:x1871083707883648:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 692us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404767.230047:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 112 00000100:00100000:3.0:1784404767.310772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404767.310883:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707883904 00000100:00100000:1.0:1784404767.310893:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707883904 00000100:00100000:1.0:1784404767.310961:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 113 00000100:00100000:1.0:1784404767.310973:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:11372:x1871083707883904:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404767.310995:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404767.311024:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79584 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7310 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311133:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311149:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311160:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311172:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311201:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311210:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311364:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79599 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311381:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311389:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404767.311398:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1784404767.311501:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311510:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311517:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311529:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404767.311534:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311541:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311569:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404767.311572:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404767.311577:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311589:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd7958b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311605:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311612:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311619:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311624:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404767.311628:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311634:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311642:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:1.0:1784404767.311645:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404767.311648:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311654:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79592 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311709:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79584 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7310 expref: 55 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311724:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7310 expref: 54 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.311737:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:1.0:1784404767.311739:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404767.311742:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759a00, rc 0) 00000100:00100000:1.0:1784404767.311826:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11372:x1871083707883904:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 855us (1080us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1784404767.311835:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 113 00000100:00100000:1.0:1784404767.317772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.318249:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707884032 00000100:00100000:2.0:1784404767.318261:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707884032 00000100:00100000:2.0:1784404767.318330:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:2.0:1784404767.318342:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11372:x1871083707884032:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1784404767.318410:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318427:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318439:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318477:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318502:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318508:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318514:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404767.318518:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318525:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318537:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404767.318540:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404767.318545:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.318550:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404767.318634:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11372:x1871083707884032:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 295us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404767.318643:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:3.0:1784404767.338834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.338962:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707884288 00000100:00100000:0.0:1784404767.338982:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707884288 00000100:00100000:0.0:1784404767.339040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:0.0:1784404767.339050:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:11372:x1871083707884288:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1784404767.339329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:11372:x1871083707884288:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 279us (504us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1784404767.339337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1784404767.441173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.441312:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707884544 00000100:00100000:0.0:1784404767.441324:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707884544 00000100:00100000:0.0:1784404767.441388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:0.0:1784404767.441397:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:11382:x1871083707884544:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404767.441422:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404767.441437:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784404767.441466:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79529 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72f4 expref: 55 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.441486:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404767.441492:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404767.441505:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd795ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7317 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.441611:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd795b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.441627:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd795b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.441637:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd795b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404767.441647:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784404767.441748:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd795ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7317 expref: 57 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.441763:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd795b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7317 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.441771:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404767.441773:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404767.441776:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ba00, rc 0) 00000100:00100000:0.0:1784404767.441845:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:11382:x1871083707884544:12345-192.168.202.42@tcp:101:bash.0 Request processed in 449us (685us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1784404767.441915:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:1.0:1784404767.449030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404767.449091:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404767.449172:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707884800 00000100:00100000:3.0:1784404767.449185:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707884800 00000100:00100000:3.0:1784404767.449256:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:3.0:1784404767.449266:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:2402:x1871083707884800:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404767.449282:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404767.449308:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd795b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7317 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.449326:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:3.0:1784404767.449332:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404767.449421:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:2402:x1871083707884800:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 154us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404767.449429:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:2.0:1784404767.449730:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707884672 00000100:00100000:2.0:1784404767.449735:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707884672 00000100:00100000:2.0:1784404767.449781:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:2.0:1784404767.449790:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:11382:x1871083707884672:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784404767.449811:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404767.449896:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed731e expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.449933:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.449945:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.449976:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.450112:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 57 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.450128:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 56 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.450135:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404767.450138:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784404767.450140:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f600, rc 0) 00000100:00100000:2.0:1784404767.450181:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:11382:x1871083707884672:12345-192.168.202.42@tcp:101:bash.0 Request processed in 392us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404767.450188:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:1.0:1784404767.456015:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.456315:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707885056 00000100:00100000:2.0:1784404767.456328:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707885056 00000100:00100000:2.0:1784404767.456400:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:2.0:1784404767.456412:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:11382:x1871083707885056:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:2.0:1784404767.456474:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404767.456516:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79599 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7310 expref: 56 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.456536:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404767.456542:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404767.456716:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.456730:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.456740:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784404767.456792:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1784404767.456814:0:9527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d078f189 reply state 0000000028c15eb8 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.456826:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.456833:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404767.456846:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404767.456949:0:9527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404767.457077:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:11382:x1871083707885056:12345-192.168.202.42@tcp:36:bash.0 Request processed in 657us (1062us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1784404767.457085:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 117 00000020:00080000:2.0:1784404767.457090:0:9527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784404767.461362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.461484:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707885184 00000100:00100000:2.0:1784404767.461493:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707885184 00000100:00100000:2.0:1784404767.461551:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:2.0:1784404767.461562:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:11382:x1871083707885184:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784404767.461603:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404767.461623:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd795d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7325 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.461734:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.461751:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.461764:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404767.461798:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784404767.461803:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404767.461825:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.463985:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd795d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.464018:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.464029:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404767.464032:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404767.464035:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e400, rc 0) 00000100:00100000:2.0:1784404767.464192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:11382:x1871083707885184:12345-192.168.202.42@tcp:101:bash.0 Request processed in 2630us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404767.464201:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:3.0:1784404767.467458:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.467549:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707885440 00000100:00100000:0.0:1784404767.467559:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707885440 00000100:00100000:0.0:1784404767.467692:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:0.0:1784404767.467703:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:11382:x1871083707885440:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:0.0:1784404767.468133:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11382:x1871083707885440:12345-192.168.202.42@tcp:35:bash.0 Request processed in 430us (682us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1784404767.468141:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1784404767.554520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404767.554843:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707885568 00000100:00100000:0.0:1784404767.555192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707885568 00000100:00100000:0.0:1784404767.555329:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:0.0:1784404767.555341:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:11389:x1871083707885568:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404767.555366:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404767.555388:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd795e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed732c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.555457:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd795ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.555471:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd795ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.555483:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd795ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404767.555525:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784404767.555529:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404767.555567:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd795ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.555591:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd795e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed732c expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.555608:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd795ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed732c expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.555616:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404767.555619:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404767.555622:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ae00, rc 0) 00000100:00100000:0.0:1784404767.555681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11389:x1871083707885568:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 343us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404767.555688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:0.0:1784404767.558684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404767.568943:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707885696 00000100:00100000:3.0:1784404767.568959:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707885696 00000100:00100000:3.0:1784404767.570225:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:3.0:1784404767.570239:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11389:x1871083707885696:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404767.570262:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404767.570283:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd795f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7333 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570352:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570367:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570379:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570391:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570398:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570404:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570475:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570484:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570508:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404767.570551:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784404767.570555:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404767.570574:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570587:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570595:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570601:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570608:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570615:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404767.570619:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570626:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570638:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:3.0:1784404767.570641:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404767.570645:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570663:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd795fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570678:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570684:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570690:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570695:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404767.570699:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570704:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570713:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:3.0:1784404767.570715:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404767.570718:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570724:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd79602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.570749:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd795f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7333 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.571182:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7333 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.571197:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:3.0:1784404767.571199:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404767.571202:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7200, rc 0) 00000100:00100000:3.0:1784404767.571359:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:11389:x1871083707885696:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1122us (12681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404767.571367:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:3.0:1784404767.577182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.577437:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707885824 00000100:00100000:2.0:1784404767.577448:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707885824 00000100:00100000:2.0:1784404767.577518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1784404767.577528:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:2403:x1871083707885824:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404767.577545:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404767.577570:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7333 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.577591:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404767.577596:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404767.577663:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:2403:x1871083707885824:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 137us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404767.577671:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:0.0:1784404767.582273:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.582357:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707886080 00000100:00100000:2.0:1784404767.582367:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707886080 00000100:00100000:2.0:1784404767.582433:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:2.0:1784404767.582444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11389:x1871083707886080:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404767.582466:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404767.582487:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79610 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed733a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.582599:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.582615:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.582624:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.582680:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.582694:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 62 pid: 6520 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404767.582707:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728923520:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404767.582804:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478780 going to sleep for 11 seconds 00000100:00100000:2.0:1784404767.592584:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728923520:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404767.592612:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404767.594535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404767.594630:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707886208 00000100:00100000:3.0:1784404767.594640:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707886208 00010000:00010000:3.0:1784404767.594679:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 63 pid: 6520 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404767.594721:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:3.0:1784404767.594733:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:2403:x1871083707886208:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404767.594749:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404767.594757:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 63 pid: 6520 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.594768:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 63 pid: 6520 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.594787:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd795df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7325 expref: 63 pid: 6520 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.594799:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:3.0:1784404767.594817:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.594827:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.594834:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.594915:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404767.594961:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:2403:x1871083707886208:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 229us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404767.594968:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00010000:00010000:0.0:1784404767.595169:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.595175:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404767.595190:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784404767.595302:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd79610 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.595327:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404767.595347:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404767.595350:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404767.595352:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fe00, rc 0) 00000100:00100000:0.0:1784404767.595392:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:11389:x1871083707886080:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 12949us (13129us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1784404767.595398:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:0.0:1784404767.599926:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404767.600023:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707886464 00000100:00100000:2.0:1784404767.600033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707886464 00000100:00100000:2.0:1784404767.600145:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:2.0:1784404767.600158:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:11389:x1871083707886464:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:2.0:1784404767.600177:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404767.600204:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79568 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7309 expref: 62 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404767.600232:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404767.600237:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404767.600297:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11389:x1871083707886464:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 143us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404767.600305:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:0.0:1784404767.606706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404767.607054:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707886592 00000100:00100000:1.0:1784404767.607076:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707886592 00000100:00100000:1.0:1784404767.607177:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:1.0:1784404767.607188:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11389:x1871083707886592:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:1.0:1784404767.607529:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.607549:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404767.607579:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404767.607676:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1784404767.607916:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11389:x1871083707886592:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 728us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404767.607925:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:0.0:1784404767.612045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404767.612454:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707886720 00000100:00100000:3.0:1784404767.612464:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707886720 00000100:00100000:3.0:1784404767.612553:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:3.0:1784404767.612564:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:11389:x1871083707886720:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404767.612581:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404767.612600:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7341 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.612657:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.612668:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.612686:0:6519:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.612716:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.612728:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:3.0:1784404767.612731:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404767.612735:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404767.612743:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7800, rc 0) 00000100:00100000:3.0:1784404767.612811:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:11389:x1871083707886720:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 243us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404767.612818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 123 00010000:00010000:2.0:1784404768.005130:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784404768.068561:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784404768.068572:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784404768.068615:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1784404768.068625:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784404768.068784:0:13786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728923648:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784404768.070423:0:13786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570673000 going to sleep for 11 seconds 00000100:00100000:0.0:1784404768.084919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.085079:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707886848 00000100:00100000:1.0:1784404768.085094:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707886848 00000100:00100000:1.0:1784404768.085178:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:1.0:1784404768.085191:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11390:x1871083707886848:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784404768.085223:0:6520:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784404768.085345:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11390:x1871083707886848:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 157us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404768.085355:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:2.0:1784404768.085925:0:13786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd442554700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728923648:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784404768.094643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.094727:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707886976 00000100:00100000:0.0:1784404768.094738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707886976 00000100:00100000:0.0:1784404768.094814:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:0.0:1784404768.094826:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:11390:x1871083707886976:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784404768.094951:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.094969:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095003:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095019:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095027:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095034:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095059:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095081:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095087:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404768.095138:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784404768.095143:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404768.095157:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095168:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095175:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095191:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095196:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.095200:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095208:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095221:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:0.0:1784404768.095223:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404768.095227:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095233:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79633 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095248:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095254:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095260:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095265:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.095268:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095285:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9dd443310900) 00010000:00010000:0.0:1784404768.095296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404768.095299:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095304:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd7963a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095319:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095325:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095331:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095336:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.095339:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095345:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095351:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404768.095354:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404768.095357:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.095372:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79641 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404768.095440:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:11390:x1871083707886976:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 615us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.095450:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:0.0:1784404768.100170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404768.100295:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707887232 00000100:00100000:3.0:1784404768.100305:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707887232 00000100:00100000:3.0:1784404768.100376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:3.0:1784404768.100387:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:11390:x1871083707887232:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404768.100411:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404768.100432:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79648 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7348 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100549:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100566:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100597:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404768.100610:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784404768.100690:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100698:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100705:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100711:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404768.100715:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100723:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:3.0:1784404768.100738:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784404768.100742:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100760:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd7964f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100804:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79648 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7348 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100826:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:3.0:1784404768.100828:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404768.100832:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79648 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7348 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.100842:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7a00, rc 0) 00000100:00100000:3.0:1784404768.100935:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11390:x1871083707887232:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 549us (782us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1784404768.100944:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:3.0:1784404768.112173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.112278:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707887360 00000100:00100000:2.0:1784404768.112288:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707887360 00000100:00100000:2.0:1784404768.112350:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:2.0:1784404768.112372:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11390:x1871083707887360:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784404768.112410:0:13543:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784404768.112536:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11390:x1871083707887360:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 176us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.112545:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:0.0:1784404768.117662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.117773:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707887616 00000100:00100000:1.0:1784404768.117784:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707887616 00000100:00100000:1.0:1784404768.117890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:1.0:1784404768.117901:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11390:x1871083707887616:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404768.117923:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404768.117926:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784404768.117955:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd795ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed732c expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.117975:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:1.0:1784404768.117980:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404768.118007:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd7965d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed734f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784404768.118397:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1784404768.118530:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79664 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.118543:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.118554:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.118607:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd7965d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed734f expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.118621:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79664 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed734f expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.118629:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869400) 00010000:00010000:1.0:1784404768.118632:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404768.118634:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759200, rc 0) 00000100:00100000:1.0:1784404768.118696:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:11390:x1871083707887616:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 795us (1044us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1784404768.118703:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:0.0:1784404768.129387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.131885:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404768.131906:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728923776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404768.131983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404768.132071:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728923776 00000100:00100000:2.0:1784404768.132079:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728923776 00000100:00100000:2.0:1784404768.132136:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784404768.132147:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728923776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404768.132194:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404768.132242:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728923776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.132248:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784404768.132293:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728923776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404768.135076:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707887872 00000100:00100000:1.0:1784404768.135091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707887872 00000100:00100000:2.0:1784404768.138243:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:2.0:1784404768.138429:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:11390:x1871083707887872:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784404768.138620:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404768.138807:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79664 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed734f expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.138830:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869400) 00010000:00010000:2.0:1784404768.138842:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404768.138943:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.138958:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139049:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139080:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139089:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139096:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139147:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139155:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139162:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139167:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404768.139182:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139190:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139199:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784404768.139202:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404768.139206:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139212:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79672 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139223:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139230:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139236:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139240:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404768.139244:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139369:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139378:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x2cfe31e1 (ffff9dd443416c00) 00010000:00010000:2.0:1784404768.139381:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404768.139390:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.139396:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79679 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2cfe31e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.139492:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:11390:x1871083707887872:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1067us (10114us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784404768.145133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.145287:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707888000 00000100:00100000:1.0:1784404768.145300:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707888000 00000100:00100000:1.0:1784404768.145379:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:1.0:1784404768.145409:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:11390:x1871083707888000:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404768.145433:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404768.145459:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79680 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7356 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.145494:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.145507:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.145520:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.145636:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79680 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 66 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.145655:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 65 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.145664:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:1.0:1784404768.145667:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404768.145671:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759000, rc 0) 00000100:00100000:1.0:1784404768.145742:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:11390:x1871083707888000:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 336us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404768.145759:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:2.0:1784404768.147408:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:0.0:1784404768.160307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404768.160608:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707888256 00000100:00100000:3.0:1784404768.160620:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707888256 00000100:00100000:3.0:1784404768.160691:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:3.0:1784404768.160702:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:11390:x1871083707888256:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784404768.160794:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.160810:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.160822:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784404768.161024:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1784404768.161036:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386045183631ns, next at 387045180548ns, rc = 0 00000004:00010000:3.0:1784404768.161100:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088b5c787 reply state 0000000072122c72 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.161134:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.161142:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:3.0:1784404768.161145:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784404768.161149:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404768.161245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:11390:x1871083707888256:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 544us (952us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1784404768.161253:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:3.0:1784404768.171710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.171902:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707888384 00000100:00100000:1.0:1784404768.171912:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707888384 00000100:00100000:1.0:1784404768.171976:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:1.0:1784404768.172001:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:11390:x1871083707888384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404768.172030:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404768.172049:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed735d expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.172136:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 67 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.172152:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 67 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.172181:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:1.0:1784404768.172184:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404768.172188:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759400, rc 0) 00000100:00100000:1.0:1784404768.172261:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:11390:x1871083707888384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 263us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404768.172269:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:0.0:1784404768.177841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.178096:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707888512 00000100:00100000:1.0:1784404768.178108:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707888512 00000100:00100000:1.0:1784404768.178191:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:1.0:1784404768.178203:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707888512:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784404768.179029:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404768.179524:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707888512:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 1318us (1688us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784404768.179534:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:3.0:1784404768.188934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.189083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707888768 00000100:00100000:2.0:1784404768.189098:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707888768 00000100:00100000:2.0:1784404768.189166:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:2.0:1784404768.189177:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:11390:x1871083707888768:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784404768.189437:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:11390:x1871083707888768:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 261us (515us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1784404768.189446:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:0.0:1784404768.193989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.194077:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707889024 00000100:00100000:2.0:1784404768.194089:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707889024 00000100:00100000:2.0:1784404768.194162:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:2.0:1784404768.194173:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4432e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:11390:x1871083707889024:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784404768.194319:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4432e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:11390:x1871083707889024:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.194328:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:3.0:1784404768.198069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.198284:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707889152 00000100:00100000:0.0:1784404768.198294:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707889152 00000100:00100000:0.0:1784404768.198413:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:0.0:1784404768.198424:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:11390:x1871083707889152:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784404768.198444:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404768.198466:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7969c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7364 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.198548:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd796a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.198563:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd796a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.198593:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd796a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404768.198638:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404768.198658:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd796a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.198683:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7969c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7364 expref: 70 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.198702:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd796a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7364 expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.198711:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:0.0:1784404768.198714:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784404768.198717:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b000, rc 0) 00000100:00100000:0.0:1784404768.198782:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd441abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+69:11390:x1871083707889152:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 360us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.198789:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:3.0:1784404768.202025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404768.202076:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707889280 00000100:00100000:3.0:1784404768.202086:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707889280 00000100:00100000:3.0:1784404768.202137:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:3.0:1784404768.202147:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707889280:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404768.202165:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404768.202184:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed736b expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404768.202212:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bdb20, blocks: 0x0 00010000:00010000:3.0:1784404768.202231:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1784404768.202236:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404768.202246:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.202298:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.202311:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6000, rc 0) 00000100:00100000:3.0:1784404768.202369:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2403:x1871083707889280:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 223us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404768.202377:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:3.0:1784404768.226305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.226427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707889536 00000100:00100000:0.0:1784404768.226439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707889536 00000100:00100000:0.0:1784404768.226520:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:0.0:1784404768.226531:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+69:11390:x1871083707889536:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784404768.226643:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+69:11390:x1871083707889536:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 113us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.226651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:2.0:1784404768.237198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.237381:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707889664 00000100:00100000:1.0:1784404768.237392:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707889664 00000100:00100000:1.0:1784404768.237471:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:1.0:1784404768.237481:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:11390:x1871083707889664:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404768.237512:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404768.237532:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7372 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.237567:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.237575:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404768.237580:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404768.237585:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.237617:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.237630:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 11 pid: 8431 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.237645:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728923904:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404768.237750:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5456830c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404768.256903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.257238:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707889792 00000100:00100000:0.0:1784404768.257269:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707889792 00010000:00010000:0.0:1784404768.257317:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 12 pid: 8431 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.257539:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:2.0:1784404768.257552:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:2404:x1871083707889792:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404768.257578:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404768.257600:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 12 pid: 8431 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.257614:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 12 pid: 8431 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.257641:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404768.257646:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404768.257654:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.257664:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.257702:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.257718:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1871083728924032:192.168.202.42@tcp:105: 00000100:00100000:2.0:1784404768.257814:0:6504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478780 going to sleep for 11 seconds 00010000:00010000:1.0:1784404768.258121:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd796aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed736b expref: 12 pid: 8431 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.258138:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728923904:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404768.258174:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.258185:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758200, rc 0) 00000100:00100000:1.0:1784404768.258215:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:11390:x1871083707889664:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 20736us (21028us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404768.258223:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:2.0:1784404768.264209:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1871083728924032:192.168.202.42@tcp:105: 00010000:00010000:2.0:1784404768.264239:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404768.264306:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2404:x1871083707889792:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 6756us (7465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.264317:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:3.0:1784404768.266895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.266936:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707889920 00000100:00100000:1.0:1784404768.266947:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707889920 00002000:00100000:1.0:1784404768.267002:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9dd541667100 x1871083707889920/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:29/0 lens 504/0 e 0 to 0 dl 1784404779 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784404768.267014:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd541667100 with x1871083707889920 ext(0->12) 00002000:00010000:1.0:1784404768.267019:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd541667100 00000100:00100000:1.0:1784404768.267044:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:1.0:1784404768.267054:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2403:x1871083707889920:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784404768.269610:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:2403:x1871083707889920:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 2547us (2714us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784404768.269633:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00002000:00100000:1.0:1784404768.269646:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9dd541667100 x1871083707889920/t4294967309(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:29/0 lens 504/448 e 0 to 0 dl 1784404779 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784404768.269657:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd541667100 with x1871083707889920 ext(0->12) 00002000:00010000:1.0:1784404768.269663:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd541667100 00000100:00100000:3.0:1784404768.273055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.273214:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707890048 00000100:00100000:2.0:1784404768.273225:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707890048 00000100:00100000:2.0:1784404768.273290:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:2.0:1784404768.273301:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+69:11390:x1871083707890048:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784404768.275986:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1784404768.276003:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1784404768.276035:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1784404768.276070:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd5817a8900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1784404768.276075:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd5452e8b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd5817a8480 00000020:00080000:3.0:1784404768.276079:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd5452e8200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4437ab200 00000004:00080000:3.0:1784404768.276097:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1784404768.276124:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd545b5e300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1784404768.276127:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd574de3a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd545b5e540 00000020:00080000:3.0:1784404768.276130:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd574de3100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4434d1600 00000020:00080000:3.0:1784404768.276142:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1784404768.276310:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404768.276331:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57ca1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728924160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784404768.276395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404768.276448:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728924160 00000100:00100000:0.0:1784404768.276454:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728924160 00000100:00100000:0.0:1784404768.276519:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784404768.276529:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728924160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784404768.276554:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1784404768.276579:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.276601:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.276610:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784404768.276615:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404768.276620:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.276649:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.276665:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 11 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404768.276695:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728924416:192.168.202.42@tcp:104: 00000020:00080000:1.0:1784404768.276758:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1784404768.276774:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570673600 going to sleep for 11 seconds 00000100:00080000:0.0:1784404768.276786:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1784404768.276813:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1784404768.276830:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728924288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784404768.276881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404768.276902:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404768.276907:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728924544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784404768.276944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404768.276981:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728924288 00000100:00100000:1.0:1784404768.276985:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728924288 00000100:00100000:1.0:1784404768.277008:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728924544 00000100:00100000:1.0:1784404768.277011:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728924544 00000100:00100000:1.0:1784404768.277026:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784404768.277031:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1871083728924288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1784404768.277123:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784404768.277127:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784404768 00002000:00010000:1.0:1784404768.277129:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784404768.277131:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1784404768 -> 1784404768 00002000:00010000:1.0:1784404768.277133:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1784404768.277180:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1871083728924288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (298us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784404768.277188:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1784404768.277198:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.277205:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1784404768.277207:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.277211:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1871083728924544:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1784404768.277214:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277220:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031000 already unused, calling callback (ffffffffc1a9f4f0) 00002000:00080000:1.0:1784404768.277222:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1784404768.277225:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277232:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784404768.277240:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a5bdb1f, atime: 0x6a5bdb1f, ctime: 0x6a5bdb1f, blocks: 0x8 00010000:00010000:1.0:1784404768.277245:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277247:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9dd44330fe00) 00010000:00010000:2.0:1784404768.277249:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404768.277253:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277260:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd793b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277265:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1784404768.277274:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404768.277280:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277282:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277289:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277295:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277300:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277304:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277305:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404768.277308:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277312:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277315:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277323:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9dd573869e00) 00010000:00010000:2.0:1784404768.277325:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404768.277328:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277329:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404768.277334:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd7945e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277350:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277356:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277362:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277366:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404768.277369:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277385:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277393:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:2.0:1784404768.277396:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404768.277399:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277404:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd794dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277415:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277422:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277427:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277432:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ec00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404768.277435:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277440:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277446:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd443416000) 00010000:00010000:2.0:1784404768.277448:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404768.277451:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277462:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd794ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277476:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277482:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277488:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277506:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404768.277509:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277515:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277522:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404768.277524:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404768.277527:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277532:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd795d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277542:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277548:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.277549:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3646:x1871083728924544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 339us (605us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784404768.277555:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1784404768.277562:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277567:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404768.277570:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277572:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404768.277576:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277577:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277585:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:1.0:1784404768.277585:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404768.277587:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784404768.277589:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277590:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.277597:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd7968e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277598:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277621:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.277696:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11390:x1871083707890048:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 4397us (4654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.277705:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 136 00010000:00010000:1.0:1784404768.277780:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af5e067e/0x24b3e2e6dcd796bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.277795:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404768.277797:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404768.277799:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784404768.278504:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd565e70700/2, rc 0, transno 4294967305 00000100:00100000:0.0:1784404768.278513:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728924544:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1784404768.278528:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd574e28700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1784404768.278532:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728924288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1784404768.286664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.287331:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707890176 00000100:00100000:0.0:1784404768.287344:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707890176 00000100:00100000:0.0:1784404768.287413:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:0.0:1784404768.287425:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:2404:x1871083707890176:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784404768.288765:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728924416:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404768.288800:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784404768.298015:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1784404768.298030:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1784404768.299298:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707890176:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 11866us (12634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.299310:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1784404768.299430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.300397:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707890304 00000100:00100000:0.0:1784404768.300407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707890304 00010000:00010000:0.0:1784404768.300447:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 7 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404768.300488:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:0.0:1784404768.300496:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570559c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707890304:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404768.300511:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404768.300517:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 7 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.300545:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 7 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.300567:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000613f790b/0x24b3e2e6dcd7946c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72ca expref: 7 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.300585:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404768.300590:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404768.300596:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.300606:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.300638:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404768.300771:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.300781:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.300792:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.300800:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.300818:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784404768.301009:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728924160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24480us (24613us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1784404768.301016:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784404768.301337:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570559c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2402:x1871083707890304:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 840us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.301345:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00010000:00010000:0.0:1784404768.301393:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404768.301398:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.301408:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404768.301412:0:10394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.301434:0:10394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.301446:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.301454:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd796b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.301471:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404768.301472:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404768.301474:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404768.301504:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1784404768.301509:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1784404768.301526:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd574e28700, transno 4294967310 00000100:00100000:0.0:1784404768.301539:0:3648:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9dd57ca1a680 x1871083728924160/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784404784 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784404768.301550:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd57ca1a680/2, rc 0, transno 4294967311 00000100:00100000:0.0:1784404768.301555:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57ca1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728924160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784404768.312360:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.313892:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707890560 00000100:00100000:0.0:1784404768.313906:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707890560 00000100:00100000:0.0:1784404768.314088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:0.0:1784404768.314100:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11390:x1871083707890560:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784404768.314158:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404768.314187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd796a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7364 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.314220:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:0.0:1784404768.314225:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404768.314256:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.314278:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.314289:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784404768.314417:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac2300c7 reply state 000000004dbd81ee transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.314430:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.314436:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:0.0:1784404768.314439:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784404768.314441:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784404768.314593:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:11390:x1871083707890560:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 495us (2244us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1784404768.314601:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:1.0:1784404768.317817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.318039:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707890688 00000100:00100000:0.0:1784404768.318051:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707890688 00000100:00100000:0.0:1784404768.318163:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1784404768.318174:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707890688:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784404768.318438:0:8488:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1784404768.318454:0:8488:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1784404768 -> 1784404767 00002000:00010000:0.0:1784404768.318457:0:8488:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784404767 00002000:00010000:0.0:1784404768.318459:0:8488:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1784404768 -> 1784404767 00002000:00010000:0.0:1784404768.318461:0:8488:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1784404768.318530:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707890688:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 357us (784us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784404768.318537:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:2.0:1784404768.326537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404768.326643:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707890944 00000100:00100000:3.0:1784404768.326654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707890944 00000100:00100000:3.0:1784404768.326715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:3.0:1784404768.326725:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:11390:x1871083707890944:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784404768.326812:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.326848:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.326891:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.326926:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.326939:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 17 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.326955:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728924672:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404768.327070:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1784404768.331616:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.333236:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707891072 00000100:00100000:1.0:1784404768.333250:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707891072 00010000:00010000:1.0:1784404768.333308:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 18 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.333347:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:1.0:1784404768.333357:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2403:x1871083707891072:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404768.333375:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404768.333382:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 18 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.333396:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 18 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.333421:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:1.0:1784404768.333440:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.333451:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.333457:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.333479:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404768.333544:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2403:x1871083707891072:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 187us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404768.333552:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 73 00010000:00010000:3.0:1784404768.333827:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7356 expref: 17 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.333882:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728924672:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404768.333906:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.333915:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.333921:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.333971:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.333985:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.333991:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.333997:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404768.334001:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.334009:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.334020:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:3.0:1784404768.334022:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784404768.334027:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.334032:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.334093:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11390:x1871083707890944:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 7369us (7570us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784404768.334103:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:2.0:1784404768.343621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.343788:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707891200 00000100:00100000:0.0:1784404768.343798:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707891200 00000100:00100000:0.0:1784404768.343884:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1784404768.343894:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707891200:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784404768.343936:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.343956:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.343965:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404768.343979:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404768.343984:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.344021:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.344035:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 7 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404768.344083:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728924800:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404768.344166:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570673780 going to sleep for 11 seconds 00000100:00100000:1.0:1784404768.346901:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728924800:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404768.346906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00010000:00010000:1.0:1784404768.346927:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.346997:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707891328 00000100:00100000:3.0:1784404768.347004:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707891328 00010000:00010000:3.0:1784404768.347035:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 8 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.347076:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:3.0:1784404768.347099:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707891328:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404768.347114:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404768.347133:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 8 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.347145:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 8 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.347166:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000731939fb/0x24b3e2e6dcd796b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7372 expref: 8 pid: 8433 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.347183:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404768.347187:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404768.347193:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.347203:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.347231:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404768.347279:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707891328:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 181us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404768.347286:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 74 00010000:00010000:1.0:1784404768.347600:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347610:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347630:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347640:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347660:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347667:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404768.347671:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347681:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347694:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.347713:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd796d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.347770:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707891200:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 3878us (4160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404768.347779:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:2.0:1784404768.353167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.353389:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707891584 00000100:00100000:0.0:1784404768.353399:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707891584 00000100:00100000:0.0:1784404768.353455:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:0.0:1784404768.353465:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:11390:x1871083707891584:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784404768.353546:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.353564:0:13543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 16 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.353574:0:13543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.353610:0:13543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 16 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.353623:0:13543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 16 pid: 13543 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404768.353637:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728924928:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404768.353711:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570673f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404768.358032:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728924928:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404768.358074:0:13543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.364477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.364707:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707891712 00000100:00100000:1.0:1784404768.364719:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707891712 00010000:00010000:1.0:1784404768.364764:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 17 pid: 13543 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.364815:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:1.0:1784404768.364836:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:2404:x1871083707891712:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404768.364870:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404768.364879:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 17 pid: 13543 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.364893:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 17 pid: 13543 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.364914:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd795ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed731e expref: 17 pid: 13543 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.364929:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:1.0:1784404768.364935:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.364945:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.364953:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.364961:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404768.364993:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404768.365047:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:2404:x1871083707891712:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 213us (580us total) trans 0 rc 0/0 00010000:00010000:3.0:1784404768.365048:0:13543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404768.365056:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 75 00010000:00010000:3.0:1784404768.365057:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.365277:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.365290:0:13543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 16 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.365298:0:13543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.365333:0:13543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 16 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.365345:0:13543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 16 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.365367:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728925056:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404768.365426:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3600 going to sleep for 11 seconds 00000100:00100000:3.0:1784404768.372082:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728925056:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404768.372119:0:13543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.374437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404768.374729:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707891840 00000100:00100000:3.0:1784404768.374762:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707891840 00010000:00010000:3.0:1784404768.374804:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 17 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.374892:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:3.0:1784404768.374904:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:2403:x1871083707891840:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404768.374918:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404768.374925:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 17 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.374938:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 17 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.374961:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79695 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed735d expref: 17 pid: 9527 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.374976:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:3.0:1784404768.374982:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.374993:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.375000:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.375026:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404768.375171:0:13543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.375190:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404768.375302:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1784404768.375442:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1784404768.375479:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1784404768.375555:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe15500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728925184:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784404768.375602:0:13543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404768.375628:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570673000 going to sleep for 11 seconds 00000100:00100000:3.0:1784404768.375815:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:2403:x1871083707891840:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 910us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404768.375833:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:2.0:1784404768.375999:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728925184 00000100:00100000:2.0:1784404768.376005:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728925184 00000100:00100000:2.0:1784404768.376050:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784404768.376068:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13543:x1871083728925184:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784404768.376166:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13543:x1871083728925184:12345-0@lo:1000:mdt00_004.0 Request processed in 109us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.376173:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784404768.377176:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe15500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728925184:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1784404768.377337:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1784404768.377403:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728925312:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784404768.377447:0:13543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404768.377469:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784404768.378479:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728925312 00000100:00100000:2.0:1784404768.378487:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728925312 00000100:00100000:2.0:1784404768.378547:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784404768.378557:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13543:x1871083728925312:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784404768.378774:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:13543:x1871083728925312:12345-0@lo:1000:mdt00_004.0 Request processed in 218us (1324us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1784404768.378782:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784404768.378950:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728925312:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1784404768.378997:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379009:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379017:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379023:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.379027:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379035:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379051:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:0.0:1784404768.379054:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784404768.379068:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379083:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd796e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379108:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379113:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379118:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379123:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.379126:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379132:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379140:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404768.379142:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784404768.379148:0:13543:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379159:0:13543:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379167:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.379211:0:13543:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404768.379224:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe14000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728925440:192.168.202.42@tcp:105: 00000100:00100000:0.0:1784404768.379287:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712900 going to sleep for 11 seconds 00000100:00100000:0.0:1784404768.384183:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe14000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728925440:192.168.202.42@tcp:105: 00010000:00010000:0.0:1784404768.384214:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384224:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79625 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384265:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384280:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384290:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384301:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384308:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384313:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384337:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.384341:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384348:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384362:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404768.384365:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404768.384369:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384374:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd796e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384384:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384389:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384394:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384399:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.384402:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384408:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384426:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404768.384429:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784404768.384432:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.384436:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd796db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404768.384882:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784404768.384887:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784404768.385479:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784404768.385487:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784404768.385727:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11390:x1871083707891584:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 32259us (32565us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1784404768.385739:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 139 00000020:00080000:0.0:1784404768.385744:0:13543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1784404768.388171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.388361:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707891968 00000100:00100000:1.0:1784404768.388388:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707891968 00000100:00100000:1.0:1784404768.388475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:1.0:1784404768.388486:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11389:x1871083707891968:12345-192.168.202.42@tcp:49:lfs.0 00000100:00100000:1.0:1784404768.388636:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11389:x1871083707891968:12345-192.168.202.42@tcp:49:lfs.0 Request processed in 152us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404768.388644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:2.0:1784404768.389981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.390168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707892224 00000100:00100000:0.0:1784404768.390177:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707892224 00000100:00100000:0.0:1784404768.390265:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:0.0:1784404768.390275:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd548288050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:11390:x1871083707892224:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784404768.390562:0:6523:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784404768.390596:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1784404768.390633:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.390650:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.390660:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.390668:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.390692:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.390697:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.390731:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784404768.390901:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd548288050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11390:x1871083707892224:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 625us (932us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784404768.390909:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000020:00080000:0.0:1784404768.390915:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784404768.390999:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404768.391006:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.391014:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ae00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404768.391018:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.391038:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.391051:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:2.0:1784404768.391054:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784404768.391068:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.391075:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd796f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.391087:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404768.391089:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404768.391090:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404768.391912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404768.392642:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707892480 00000100:00100000:0.0:1784404768.392651:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707892480 00000100:00100000:0.0:1784404768.392700:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:0.0:1784404768.392709:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11389:x1871083707892480:12345-192.168.202.42@tcp:58:lfs.0 00000040:00080000:0.0:1784404768.392882:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1784404768.392954:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11389:x1871083707892480:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 245us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.392963:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:2.0:1784404768.425595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404768.425766:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707892608 00000100:00100000:3.0:1784404768.425776:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707892608 00000100:00100000:3.0:1784404768.425847:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:3.0:1784404768.425900:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:11392:x1871083707892608:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404768.425922:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404768.425942:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd796f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7379 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.426013:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.426029:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.426041:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.426055:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.426073:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404768.426099:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.426241:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.426252:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.426260:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.426295:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.426308:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 22 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.426334:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728925568:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404768.426433:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478780 going to sleep for 11 seconds 00000100:00100000:2.0:1784404768.430748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404768.430958:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707892864 00000100:00100000:1.0:1784404768.430978:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707892864 00000100:00100000:1.0:1784404768.431047:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:1.0:1784404768.431069:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:6170:x1871083707892864:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784404768.431330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:6170:x1871083707892864:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 273us (591us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1784404768.431339:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:0.0:1784404768.431448:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728925568:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404768.431474:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404768.434741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.434910:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707892992 00000100:00100000:2.0:1784404768.434921:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707892992 00010000:00010000:2.0:1784404768.434971:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 24 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404768.435015:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:2.0:1784404768.435024:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:2403:x1871083707892992:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404768.435040:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404768.435048:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 24 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.435073:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 24 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.435099:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79617 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed733a expref: 24 pid: 6520 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.435116:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404768.435122:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.435132:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.435160:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404768.435195:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404768.435255:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:2403:x1871083707892992:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 232us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.435262:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00010000:00010000:0.0:1784404768.435387:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435397:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404768.435460:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784404768.435464:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404768.435484:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435496:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435506:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435511:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435518:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435524:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.435528:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435535:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435544:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404768.435546:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404768.435551:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435557:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd796fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435583:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435589:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435595:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435600:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404768.435603:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435609:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435618:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9dd542a40200) 00010000:00010000:0.0:1784404768.435621:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404768.435624:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435630:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435667:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd796f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7379 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435680:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7379 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404768.435699:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404768.435701:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404768.435704:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fc00, rc 0) 00000100:00100000:0.0:1784404768.435732:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:11392:x1871083707892608:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 9836us (10147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.435739:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:2.0:1784404768.985442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.985526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.985560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.985582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.985601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.985620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.985643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404768.985671:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707893504 00000100:00100000:2.0:1784404768.985681:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707893504 00000100:00100000:2.0:1784404768.985732:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707893632 00000100:00100000:2.0:1784404768.985735:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707893632 00000100:00100000:2.0:1784404768.985756:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1784404768.985765:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707893504:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404768.985833:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707893504:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.985841:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1784404768.985882:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:2.0:1784404768.985889:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707893632:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404768.985915:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707893632:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.985929:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:2.0:1784404768.985948:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707893248 00000100:00100000:2.0:1784404768.985952:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707893248 00000100:00100000:2.0:1784404768.985975:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707893760 00000100:00100000:2.0:1784404768.985977:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707893760 00000100:00100000:2.0:1784404768.985991:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707893376 00000100:00100000:2.0:1784404768.985994:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707893376 00000100:00100000:2.0:1784404768.986006:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707893888 00000100:00100000:2.0:1784404768.986009:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707893888 00000100:00100000:2.0:1784404768.986025:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 273 00000100:00100000:2.0:1784404768.986031:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2403:x1871083707893248:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404768.986077:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2403:x1871083707893248:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 45us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.986083:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 273 00000100:00100000:2.0:1784404768.986097:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 274 00000100:00100000:2.0:1784404768.986104:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707893760:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404768.986126:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707893760:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.986131:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 274 00000100:00100000:2.0:1784404768.986143:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 275 00000100:00100000:2.0:1784404768.986148:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707893376:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404768.986174:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707893376:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.986180:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 275 00000100:00100000:2.0:1784404768.986193:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 276 00000100:00100000:2.0:1784404768.986207:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707893888:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404768.986230:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707893888:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404768.986236:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 276 00000100:00080000:2.0:1784404768.986921:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404768.986925:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404768.986928:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404768.990132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707893120 00000100:00100000:0.0:1784404768.990147:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707893120 00000100:00100000:0.0:1784404768.990233:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 376 00000100:00100000:0.0:1784404768.990247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707893120:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404768.990352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707893120:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 107us (4916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404768.990367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 376 00010000:00010000:1.0:1784404769.028074:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404769.157197:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728925696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404769.157282:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404769.157377:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728925696 00000100:00100000:2.0:1784404769.157385:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728925696 00000100:00100000:2.0:1784404769.157432:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784404769.157440:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728925696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404769.157473:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1784404769.157519:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728925696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404769.157526:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784404769.157572:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728925696:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1784404769.159932:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1784404769.159950:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:3.0:1784404769.275700:0:14258:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784404769.275709:0:14258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784404769.275752:0:14258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784404769.275760:0:14258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1784404769.413303:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784404769.413314:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784404769.413352:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784404769.413360:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784404769.413500:0:13786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d30a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728925824:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784404769.413593:0:13786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404769.416488:0:13786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d30a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728925824:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784404769.419700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404769.420007:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707894016 00000100:00100000:3.0:1784404769.420022:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707894016 00000100:00100000:3.0:1784404769.420163:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:3.0:1784404769.420176:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:11404:x1871083707894016:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784404769.420214:0:13543:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784404769.420350:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:11404:x1871083707894016:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 176us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404769.420358:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00080000:1.0:1784404769.427098:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404769.428825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404769.428879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707894272 00000100:00100000:2.0:1784404769.428888:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707894272 00000100:00100000:2.0:1784404769.429018:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:2.0:1784404769.429029:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:11404:x1871083707894272:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404769.429061:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404769.429085:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79713 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7380 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.429214:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd7971a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.429229:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd7971a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.429242:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd7971a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404769.429254:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1784404769.429365:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79713 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7380 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.429381:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd7971a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7380 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.429391:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404769.429394:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404769.429398:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f800, rc 0) 00000100:00100000:2.0:1784404769.429474:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:11404:x1871083707894272:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 446us (656us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1784404769.429482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:3.0:1784404769.438226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404769.438273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404769.438338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707894400 00000100:00100000:1.0:1784404769.438349:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707894400 00000100:00100000:1.0:1784404769.438414:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1784404769.438425:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:2402:x1871083707894400:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404769.438441:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404769.438466:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd7971a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7380 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404769.438483:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:1.0:1784404769.438494:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404769.438551:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:2402:x1871083707894400:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 129us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404769.438558:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:2.0:1784404769.438736:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707894656 00000100:00100000:2.0:1784404769.438741:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707894656 00000100:00100000:2.0:1784404769.438780:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:2.0:1784404769.438788:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:11404:x1871083707894656:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784404769.438892:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.438914:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.438926:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.439288:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.439297:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.439303:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.439308:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404769.439312:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.439319:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.439329:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:2.0:1784404769.439332:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784404769.439336:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404769.439342:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79728 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404769.439576:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404769.439580:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1784404769.441437:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:11404:x1871083707894656:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 2638us (3152us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1784404769.441466:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 144 00000040:00080000:1.0:1784404769.441754:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784404769.441766:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784404769.446454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404769.446523:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707894912 00000100:00100000:1.0:1784404769.446533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707894912 00000100:00100000:1.0:1784404769.446589:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:1.0:1784404769.446601:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:11404:x1871083707894912:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784404769.446835:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:11404:x1871083707894912:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 236us (388us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1784404769.446842:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00010000:00010000:0.0:1784404770.051159:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404771.075408:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784404771.146753:0:14310:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404771.146765:0:14310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404771.146799:0:14310:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784404771.146805:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784404771.332160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404771.332235:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707895168 00000100:00100000:0.0:1784404771.332245:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707895168 00000100:00100000:0.0:1784404771.332327:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:0.0:1784404771.332337:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:11424:x1871083707895168:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404771.332362:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404771.332383:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7972f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7387 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.332495:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79736 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.332525:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79736 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.332536:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79736 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404771.332549:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784404771.332640:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7972f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7387 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.332653:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79736 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7387 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.332659:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404771.332661:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784404771.332663:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ba00, rc 0) 00000100:00100000:0.0:1784404771.332708:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:11424:x1871083707895168:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 374us (559us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1784404771.332713:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00080000:1.0:1784404771.332941:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404771.335165:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404771.335236:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707895296 00000100:00100000:0.0:1784404771.335255:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707895296 00000100:00100000:0.0:1784404771.335316:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:0.0:1784404771.335325:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:11424:x1871083707895296:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1784404771.335383:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335398:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335421:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335452:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335459:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335466:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335472:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151bc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404771.335476:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335482:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335493:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404771.335496:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404771.335500:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404771.335506:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404771.335573:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:11424:x1871083707895296:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 249us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404771.335579:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:0.0:1784404771.460705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404771.460800:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707895424 00000100:00100000:2.0:1784404771.460810:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707895424 00000100:00100000:2.0:1784404771.460928:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:2.0:1784404771.460939:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2402:x1871083707895424:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1784404771.460956:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404771.460977:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d82b05/0x24b3e2e6dcd7974b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed738e expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784404771.461004:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a5bdb1f, atime: 0x6a5bdb1f, ctime: 0x6a5bdb1f, blocks: 0x8 00010000:00010000:2.0:1784404771.461023:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1784404771.461028:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404771.461046:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d82b05/0x24b3e2e6dcd7974b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed738e expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404771.461065:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1d82b05/0x24b3e2e6dcd7974b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed738e expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404771.461078:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fa00, rc 0) 00000100:00100000:2.0:1784404771.461138:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707895424:12345-192.168.202.42@tcp:101:cat.0 Request processed in 202us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404771.461145:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00080000:1.0:1784404771.462177:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404771.464970:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404771.465045:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707895552 00000100:00100000:2.0:1784404771.465056:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707895552 00002000:00100000:2.0:1784404771.465108:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9dd577ffb800 x1871083707895552/t0(0) o3->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:32/0 lens 488/0 e 0 to 0 dl 1784404782 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784404771.465140:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd577ffb800 with x1871083707895552 ext(0->4095) 00002000:00010000:2.0:1784404771.465146:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd577ffb800 00000100:00100000:2.0:1784404771.465172:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1784404771.465181:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707895552:12345-192.168.202.42@tcp:3:cat.0 00000100:00100000:2.0:1784404771.465384:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707895552:12345-192.168.202.42@tcp:3:cat.0 Request processed in 204us (422us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784404771.465392:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00002000:00100000:2.0:1784404771.465399:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9dd577ffb800 x1871083707895552/t0(0) o3->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:32/0 lens 488/4536 e 0 to 0 dl 1784404782 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784404771.465407:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd577ffb800 with x1871083707895552 ext(0->4095) 00002000:00010000:2.0:1784404771.465411:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd577ffb800 00000100:00100000:2.0:1784404771.715276:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728926208:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404771.715409:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728926720:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404771.715459:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728927232:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715480:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404771.715502:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784404771.715507:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728926080:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404771.715537:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728926592:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404771.715575:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728927104:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404771.715619:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926720 00000100:00100000:2.0:1784404771.715626:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926720 00000100:00100000:2.0:1784404771.715679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728927232 00000100:00100000:2.0:1784404771.715683:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728927232 00000100:00100000:2.0:1784404771.715698:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926080 00000100:00100000:2.0:1784404771.715700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926080 00000100:00100000:2.0:1784404771.715710:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926592 00000100:00100000:2.0:1784404771.715713:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926592 00000100:00100000:2.0:1784404771.715726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728927104 00000100:00100000:2.0:1784404771.715728:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728927104 00000100:00100000:2.0:1784404771.715746:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784404771.715753:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728926720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715811:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728926720:12345-0@lo:400:kworker.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404771.715818:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784404771.715836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784404771.715842:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728927232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715893:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728927232:12345-0@lo:400:kworker.0 Request processed in 51us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404771.715899:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784404771.715912:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1784404771.715917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728926080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715941:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728926080:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404771.715947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1784404771.715956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1784404771.715967:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728926592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.715992:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728926592:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404771.715997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1784404771.716007:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1784404771.716012:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728927104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.716047:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728927104:12345-0@lo:400:kworker.0 Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404771.716052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1784404771.716089:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728926080:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.716099:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728926592:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.716108:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728927104:0@lo:400:kworker.0 00010000:00080000:2.0:1784404771.716120:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d87480 x1871083728926720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404771.716130:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728926720:0@lo:400:kworker.0 00010000:00080000:2.0:1784404771.716138:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d84000 x1871083728927232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404771.716146:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728927232:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716249:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728925952:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716283:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404771.716317:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728926464:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404771.716358:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728926976:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404771.716394:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728927488:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716414:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404771.716433:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784404771.716439:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728926336:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716460:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404771.716476:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728926848:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716492:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404771.716507:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728927360:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404771.716547:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926208 00000100:00100000:3.0:1784404771.716550:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926208 00000100:00100000:3.0:1784404771.716577:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926464 00000100:00100000:3.0:1784404771.716579:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926464 00000100:00100000:3.0:1784404771.716593:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784404771.716599:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728926208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716636:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728926208:12345-0@lo:400:kworker.0 Request processed in 37us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404771.716655:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784404771.716668:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784404771.716674:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728926464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716708:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728926464:12345-0@lo:400:kworker.0 Request processed in 33us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404771.716713:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784404771.716731:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926336 00000100:00100000:3.0:1784404771.716734:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926336 00000100:00100000:3.0:1784404771.716750:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784404771.716756:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728926336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716783:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728926336:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404771.716788:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784404771.716812:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926976 00000100:00100000:3.0:1784404771.716815:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926976 00000100:00100000:3.0:1784404771.716831:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728927488 00000100:00100000:3.0:1784404771.716833:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728927488 00000100:00100000:3.0:1784404771.716842:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728926848 00000100:00100000:3.0:1784404771.716844:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728926848 00000100:00100000:3.0:1784404771.716875:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728927360 00000100:00100000:3.0:1784404771.716877:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728927360 00000100:00100000:3.0:1784404771.716888:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784404771.716893:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728926976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716919:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728926976:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404771.716924:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784404771.716932:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784404771.716943:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083728927488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.716966:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083728927488:12345-0@lo:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404771.716971:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784404771.716980:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784404771.716984:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728926848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.717004:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728926848:12345-0@lo:400:kworker.0 Request processed in 19us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404771.717008:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784404771.717015:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784404771.717019:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728927360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.717053:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728927360:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404771.717058:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784404771.717083:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728926336:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.717091:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728926848:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.717098:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728927360:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.717105:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728926464:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.717112:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1784404771.717116:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1784404771.717131:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd57fe14380, transno 4294967302 00000004:00080000:3.0:1784404771.717140:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1784404771.717149:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd565e70700, transno 4294967305 00000100:00100000:3.0:1784404771.717153:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728926976:0@lo:400:kworker.0 00000100:00100000:3.0:1784404771.717170:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728927488:0@lo:400:kworker.0 00000100:00080000:1.0:1784404771.717429:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404771.717434:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404771.717436:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404771.717439:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404771.717555:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728927616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404771.717587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404771.717648:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728927616 00000100:00100000:0.0:1784404771.717652:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728927616 00000100:00100000:0.0:1784404771.717680:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784404771.717686:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728927616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784404771.717708:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784404771.717738:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728927616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404771.717744:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784404771.717776:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728927616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404771.717786:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404771.717791:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728927744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404771.717812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404771.717837:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728927744 00000100:00100000:0.0:1784404771.717840:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728927744 00000100:00100000:0.0:1784404771.717877:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784404771.717883:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728927744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404771.717897:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404771.717926:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728927744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404771.717932:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784404771.717957:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728927744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404771.718060:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404771.718069:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728927872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404771.718104:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404771.718171:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728927872 00000100:00100000:0.0:1784404771.718175:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728927872 00000100:00100000:0.0:1784404771.718205:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784404771.718217:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728927872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784404771.718226:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404771.718254:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728927872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404771.718260:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784404771.718331:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728927872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404771.718403:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728925952 00000100:00100000:2.0:1784404771.718407:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728925952 00000100:00100000:2.0:1784404771.718442:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1784404771.718448:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728925952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.718532:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728925952:12345-0@lo:400:kworker.0 Request processed in 84us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404771.718544:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1784404771.718593:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728926208:0@lo:400:kworker.0 00000100:00100000:2.0:1784404771.723672:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404771.723707:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728928000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404771.723790:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404771.723947:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928000 00000100:00100000:0.0:1784404771.723957:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928000 00000100:00100000:0.0:1784404771.724016:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784404771.724027:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083728928000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404771.724067:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784404771.724130:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083728928000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404771.724137:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784404771.724253:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728928000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404771.727062:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728925952:0@lo:400:kworker.0 00010000:00010000:1.0:1784404772.099715:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404773.123163:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404773.251169:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404773.251198:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728928128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404773.251275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404773.252724:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928128 00000100:00100000:2.0:1784404773.252736:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928128 00000100:00100000:2.0:1784404773.252807:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784404773.252819:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728928128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404773.252881:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404773.252975:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728928128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404773.252982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784404773.253242:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728928128:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784404773.574792:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404773.574800:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404773.574817:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784404773.574822:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784404773.892667:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784404774.095672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404774.095729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404774.095762:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707895680 00000100:00100000:3.0:1784404774.095764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404774.095773:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707895680 00000100:00100000:3.0:1784404774.095831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404774.095833:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 378 00000100:00100000:1.0:1784404774.095844:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707895680:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404774.095882:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404774.095900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404774.095958:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707895936 00000100:00100000:2.0:1784404774.095962:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707895936 00000100:00100000:2.0:1784404774.096003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707896448 00000100:00100000:2.0:1784404774.096007:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707896448 00000100:00100000:2.0:1784404774.096040:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707895808 00000100:00100000:2.0:1784404774.096043:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707895808 00000100:00100000:2.0:1784404774.096061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 283 00000100:00100000:2.0:1784404774.096068:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707895936:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404774.096832:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2404:x1871083707895680:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 286us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404774.096841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 378 00000100:00080000:1.0:1784404774.096915:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404774.096919:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404774.097018:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707896192 00000100:00100000:0.0:1784404774.097025:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707896192 00000100:00100000:0.0:1784404774.097070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707896064 00000100:00100000:0.0:1784404774.097074:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707896064 00000100:00100000:0.0:1784404774.097101:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:0.0:1784404774.097109:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707896192:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404774.100933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404774.101259:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:3.0:1784404774.101277:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707896064:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404774.101381:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707896064:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 111us (5479us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404774.101389:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:1.0:1784404774.109351:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707896320 00000100:00100000:1.0:1784404774.109367:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707896320 00000100:00100000:1.0:1784404774.109428:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 284 00000100:00100000:1.0:1784404774.109439:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707896448:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404774.109533:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707896448:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 95us (13700us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404774.109541:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 284 00000100:00100000:1.0:1784404774.109560:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 285 00000100:00100000:1.0:1784404774.109567:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:2404:x1871083707895808:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404774.109603:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:2404:x1871083707895808:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 37us (13721us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404774.109610:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 285 00000100:00100000:1.0:1784404774.109624:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 286 00000100:00100000:1.0:1784404774.109630:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707896320:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404774.109653:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2404:x1871083707896320:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (8730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404774.109660:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 286 00000100:00100000:0.0:1784404774.109894:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707896192:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 12783us (14126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404774.109903:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00080000:0.0:1784404774.109929:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404774.109940:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404774.109942:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404774.110792:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2404:x1871083707895936:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 14718us (15056us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404774.110801:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 283 00010000:00010000:0.0:1784404774.148285:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404774.280239:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728928256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404774.280325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404774.280567:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928256 00000100:00100000:0.0:1784404774.280576:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928256 00000100:00100000:0.0:1784404774.280643:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784404774.280653:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728928256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404774.280692:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1784404774.280748:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728928256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404774.280755:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784404774.280802:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728928256:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1784404774.282516:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1784404774.282528:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1784404774.283704:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1784404774.283733:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd4435e3780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1784404774.283739:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd57c8f5200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4435e3600 00000020:00080000:2.0:1784404774.283742:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd57c8f5c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4434a3a00 00000020:00080000:2.0:1784404774.283769:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:1.0:1784404774.283913:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404774.283923:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404774.283928:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404774.283932:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404774.283935:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404774.283940:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404774.283953:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9dd573869300) 00010000:00010000:1.0:1784404774.283955:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404774.283967:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404774.283972:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd796c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784404774.284021:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1784404774.284101:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1784404775.178637:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404775.474684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404775.475365:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707896576 00000100:00100000:3.0:1784404775.475378:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707896576 00000100:00100000:2.0:1784404775.475525:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00100000:2.0:1784404775.475537:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:11076:x1871083707896576:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784404775.475669:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:11076:x1871083707896576:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 134us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404775.475677:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 147 00000100:00100000:0.0:1784404775.486129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404775.486333:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707896704 00000100:00100000:2.0:1784404775.486346:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707896704 00000100:00100000:2.0:1784404775.486413:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:2.0:1784404775.486424:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:11076:x1871083707896704:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784404775.486587:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:11076:x1871083707896704:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 164us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404775.486595:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:3.0:1784404775.499450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404775.499612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707896960 00000100:00100000:1.0:1784404775.499622:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707896960 00000100:00100000:1.0:1784404775.499734:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:1.0:1784404775.499756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:11076:x1871083707896960:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784404775.500333:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:11076:x1871083707896960:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 587us (890us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1784404775.500342:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:1.0:1784404775.673505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404775.673639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897088 00000100:00100000:2.0:1784404775.673651:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897088 00000100:00100000:2.0:1784404775.673722:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:2.0:1784404775.673735:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:11883:x1871083707897088:12345-192.168.202.42@tcp:101:lsof.0 00010000:00010000:2.0:1784404775.673760:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404775.673785:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7395 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404775.673915:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404775.673930:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404775.673944:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404775.674012:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784404775.674016:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404775.674280:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404775.674304:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404775.674324:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404775.674333:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:2.0:1784404775.674336:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784404775.674340:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f800, rc 0) 00000100:00100000:2.0:1784404775.674412:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:11883:x1871083707897088:12345-192.168.202.42@tcp:101:lsof.0 Request processed in 679us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404775.674419:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 149 00010000:00010000:0.0:1784404776.197054:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404776.835505:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728928384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404776.835561:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404776.835579:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728928640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404776.835611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404776.835721:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728928512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404776.835833:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728929152:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.842330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.842424:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728928768:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.842479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.842521:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728929280:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.842558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.842581:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728929792:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.842603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.842631:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728930304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404776.842651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.842693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928768 00000100:00100000:2.0:1784404776.842702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928768 00000100:00100000:2.0:1784404776.842757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1784404776.842766:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728928768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.842820:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3647:x1871083728928768:12345-0@lo:400:kworker.0 Request processed in 54us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.842827:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1784404776.842875:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929280 00000100:00100000:2.0:1784404776.842879:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929280 00000100:00100000:2.0:1784404776.842907:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784404776.842913:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728929280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.842946:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728929280:12345-0@lo:400:kworker.0 Request processed in 33us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.842952:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784404776.842968:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928384 00000100:00100000:2.0:1784404776.842972:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928384 00000100:00100000:2.0:1784404776.843021:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928640 00000100:00100000:2.0:1784404776.843040:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928640 00000100:00100000:2.0:1784404776.843057:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930304 00000100:00100000:2.0:1784404776.843059:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930304 00000100:00100000:2.0:1784404776.843073:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784404776.843079:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728928384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404776.843101:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784404776.843130:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728928384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (7521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.843136:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784404776.843146:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784404776.843151:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728928640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404776.843158:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784404776.843176:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728928640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 26us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.843182:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784404776.843191:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784404776.843195:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728930304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404776.843208:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404776.843227:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728930304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.843231:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1784404776.843244:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404776.843247:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404776.843273:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728928768:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.843285:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728929280:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.843300:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728930304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404776.843318:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1784404776.843324:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd57ca1a680, transno 4294967311 00000004:00080000:2.0:1784404776.843335:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1784404776.843359:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728928640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404776.843497:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929792 00000100:00100000:2.0:1784404776.843501:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929792 00000100:00100000:2.0:1784404776.843533:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784404776.843539:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728929792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.843583:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728929792:12345-0@lo:400:kworker.0 Request processed in 43us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.843589:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1784404776.843609:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404776.843623:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728929792:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.843654:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728928384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404776.843669:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728928896:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.843740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404776.843784:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928896 00000100:00100000:3.0:1784404776.843796:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928896 00000100:00100000:3.0:1784404776.843835:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1784404776.843843:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728928896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.843903:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728928896:12345-0@lo:400:kworker.0 Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404776.843909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1784404776.843937:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728928896:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.843945:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728929408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.843968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404776.843998:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728929920:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.844020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404776.844045:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784404776.844051:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728929024:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.844074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404776.844090:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728929536:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.844111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404776.844126:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728930048:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.844148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.844164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929408 00000100:00100000:2.0:1784404776.844169:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929408 00000100:00100000:2.0:1784404776.844194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1784404776.844200:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728929408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.844230:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728929408:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.844235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1784404776.844245:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929920 00000100:00100000:2.0:1784404776.844248:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929920 00000100:00100000:1.0:1784404776.844276:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929536 00000100:00100000:2.0:1784404776.844277:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930048 00000100:00100000:1.0:1784404776.844283:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929536 00000100:00100000:2.0:1784404776.844284:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930048 00000100:00100000:2.0:1784404776.844303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784404776.844311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728929920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404776.844321:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784404776.844344:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728929920:12345-0@lo:400:kworker.0 Request processed in 34us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404776.844502:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728930048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404776.844553:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728930048:12345-0@lo:400:kworker.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.844602:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784404776.844618:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784404776.844625:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728929536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.844655:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728929536:12345-0@lo:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.844661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784404776.844680:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929024 00000100:00100000:2.0:1784404776.844683:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929024 00000100:00100000:2.0:1784404776.844707:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784404776.844712:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728929024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.844741:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728929024:12345-0@lo:400:kworker.0 Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.844746:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1784404776.844762:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404776.844766:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784404776.844796:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c8d500 x1871083728930048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404776.844809:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728930048:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.844818:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728929408:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.844827:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728929920:0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.844877:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728929024:0@lo:400:kworker.0 00010000:00080000:2.0:1784404776.844887:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443c8f800 x1871083728929536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404776.844894:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728929536:0@lo:400:kworker.0 00000100:00100000:1.0:1784404776.845269:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1784404776.845305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.845413:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728928512 00000100:00100000:2.0:1784404776.845418:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728928512 00000100:00100000:2.0:1784404776.845447:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1784404776.845453:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728928512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404776.845468:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404776.845962:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728928512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 508us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.845973:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784404776.846734:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728928512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404776.846872:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404776.846913:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728929664:0@lo:400:kworker.0 00000100:00100000:0.0:1784404776.846951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404776.846956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929152 00000100:00100000:2.0:1784404776.846963:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929152 00000100:00100000:0.0:1784404776.846981:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728930176:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.847263:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728929664 00000100:00100000:3.0:1784404776.847268:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728929664 00000100:00100000:3.0:1784404776.847296:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784404776.847305:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728929664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.847319:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1784404776.847329:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728929152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404776.847371:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728929152:12345-0@lo:400:kworker.0 Request processed in 44us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404776.847377:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784404776.847512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404776.847538:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930176 00000100:00100000:1.0:1784404776.847543:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930176 00000100:00100000:0.0:1784404776.847557:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728929152:0@lo:400:kworker.0 00000100:00100000:1.0:1784404776.847585:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784404776.847592:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728930176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404776.847630:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728930176:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404776.847638:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784404776.847651:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728930176:0@lo:400:kworker.0 00000100:00100000:3.0:1784404776.847930:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728929664:12345-0@lo:400:kworker.0 Request processed in 626us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404776.847937:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784404776.848117:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728929664:0@lo:400:kworker.0 00010000:00010000:0.0:1784404777.219088:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404778.244080:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404778.375090:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728930432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404778.375176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404778.375400:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930432 00000100:00100000:0.0:1784404778.375409:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930432 00000100:00100000:0.0:1784404778.375480:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784404778.375491:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728930432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404778.375533:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404778.375589:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728930432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404778.375597:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784404778.375646:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728930432:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1784404779.094691:0:14507:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:59:38 (1784404778) 00000100:00100000:0.0:1784404779.219164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404779.219205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404779.219233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404779.219254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404779.219295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404779.219321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404779.219347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404779.219377:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897472 00000100:00100000:0.0:1784404779.219387:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897472 00000100:00100000:0.0:1784404779.219444:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897984 00000100:00100000:0.0:1784404779.219447:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897984 00000100:00100000:0.0:1784404779.219460:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897344 00000100:00100000:0.0:1784404779.219462:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897344 00000100:00100000:0.0:1784404779.219473:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897856 00000100:00100000:0.0:1784404779.219476:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897856 00000100:00100000:0.0:1784404779.219492:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 293 00000100:00100000:0.0:1784404779.219500:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707897472:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404779.219601:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707897472:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 100us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404779.219617:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 293 00000100:00100000:0.0:1784404779.219637:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 294 00000100:00100000:0.0:1784404779.219644:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707897984:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404779.219670:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707897984:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404779.219676:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 294 00000100:00100000:0.0:1784404779.219688:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 295 00000100:00100000:0.0:1784404779.219694:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:2403:x1871083707897344:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404779.219721:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:2403:x1871083707897344:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404779.219727:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 295 00000100:00100000:0.0:1784404779.219736:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 296 00000100:00100000:0.0:1784404779.219742:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707897856:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404779.219763:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707897856:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 22us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404779.219769:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 296 00000100:00100000:0.0:1784404779.219788:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897728 00000100:00100000:0.0:1784404779.219792:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897728 00000100:00100000:0.0:1784404779.219825:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897600 00000100:00100000:0.0:1784404779.219827:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897600 00000100:00100000:0.0:1784404779.219872:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:0.0:1784404779.219879:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707897728:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404779.219905:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707897728:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404779.219918:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:0.0:1784404779.219930:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:0.0:1784404779.219936:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707897600:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404779.219961:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707897600:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404779.219991:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00080000:0.0:1784404779.220020:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404779.220024:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404779.220027:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404779.220028:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404779.221106:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707897216 00000100:00100000:2.0:1784404779.221116:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707897216 00000100:00100000:2.0:1784404779.221173:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 380 00000100:00100000:2.0:1784404779.221182:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707897216:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404779.221242:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707897216:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 61us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404779.221265:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 380 00010000:00010000:1.0:1784404779.269084:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404779.395213:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728930560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404779.395293:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404779.395483:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930560 00000100:00100000:3.0:1784404779.395491:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930560 00000100:00100000:3.0:1784404779.395546:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784404779.395556:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728930560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404779.395591:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1784404779.395831:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728930560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404779.396027:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728930560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404779.396037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000001:00080000:2.0:1784404779.909125:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1784404779.909140:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1784404779.909198:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1784404779.909223:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1784404780.291153:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404780.343035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404780.343147:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707898240 00000100:00100000:2.0:1784404780.343157:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707898240 00000100:00100000:2.0:1784404780.343225:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 150 00000100:00100000:2.0:1784404780.343238:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:12150:x1871083707898240:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404780.343264:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404780.343287:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79760 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed739c expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343364:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343381:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343394:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343410:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343417:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343425:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343522:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79775 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343546:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79775 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343554:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79775 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404780.343565:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784404780.343665:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343673:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343679:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343685:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516fe00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404780.343690:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343698:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343738:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd443413d00) 00010000:00010000:2.0:1784404780.343741:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404780.343745:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343752:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79767 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343765:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343777:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343783:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343787:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404780.343791:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343797:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343806:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd443416200) 00010000:00010000:2.0:1784404780.343809:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404780.343812:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.343817:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7976e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.344159:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79760 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed739c expref: 16 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.344177:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79775 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed739c expref: 15 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404780.344185:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:2.0:1784404780.344187:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404780.344197:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e200, rc 0) 00000100:00100000:2.0:1784404780.344271:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:12150:x1871083707898240:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1247us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1784404780.344285:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 150 00000100:00100000:2.0:1784404780.351417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404780.351928:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707898496 00000100:00100000:0.0:1784404780.351941:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707898496 00000100:00100000:0.0:1784404780.352030:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:0.0:1784404780.352151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:12150:x1871083707898496:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1784404780.352329:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:12150:x1871083707898496:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 289us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404780.352339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:3.0:1784404780.358750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404780.359178:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707898368 00000100:00100000:1.0:1784404780.359190:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707898368 00000100:00100000:1.0:1784404780.359305:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:1.0:1784404780.359330:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:2402:x1871083707898368:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404780.359348:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404780.359374:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79775 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed739c expref: 15 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404780.359393:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:1.0:1784404780.359399:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404780.359461:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:2402:x1871083707898368:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 147us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404780.359469:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1784404780.373358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404780.373517:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707898624 00000100:00100000:2.0:1784404780.373529:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707898624 00000100:00100000:2.0:1784404780.373597:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 152 00000100:00100000:2.0:1784404780.373608:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:12150:x1871083707898624:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784404780.373719:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:12150:x1871083707898624:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 113us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404780.373727:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 152 00000040:00080000:1.0:1784404780.743652:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404780.743663:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404780.744199:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784404780.744211:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784404781.062642:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784404781.318056:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404781.956195:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728930688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404781.956279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404781.956417:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930688 00000100:00100000:3.0:1784404781.956428:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930688 00000100:00100000:3.0:1784404781.956502:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784404781.956514:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728930688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404781.956548:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404781.956600:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728930688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.956607:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1784404781.956675:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404781.956710:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728930688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404781.957612:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404781.957626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728930944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404781.957670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404781.957720:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930944 00000100:00100000:1.0:1784404781.957726:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930944 00000100:00100000:1.0:1784404781.957766:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784404781.957776:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728930944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784404781.957799:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784404781.957833:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728930944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404781.957840:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784404781.957880:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728930816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404781.957907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404781.957951:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728930816 00000100:00100000:1.0:1784404781.957955:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728930816 00000100:00100000:1.0:1784404781.957981:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784404781.957987:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728930816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404781.957997:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784404781.958027:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728930816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404781.958053:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1784404781.958070:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404781.958102:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728930816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404781.958135:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728930944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784404781.962190:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784404781.962214:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728931072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404781.962289:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404781.962365:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931072 00000100:00100000:3.0:1784404781.962373:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931072 00000100:00100000:3.0:1784404781.962437:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784404781.962447:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728931072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404781.962491:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404781.962537:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728931072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.962545:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1784404781.962570:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404781.962614:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728931072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404781.965002:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728931584:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965068:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404781.965125:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728932096:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404781.965176:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784404781.965181:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728931456:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965207:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404781.965226:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728931968:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965263:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404781.965298:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931584 00000100:00100000:3.0:1784404781.965313:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931584 00000100:00100000:3.0:1784404781.965362:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728932096 00000100:00100000:3.0:1784404781.965366:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728932096 00000100:00100000:3.0:1784404781.965392:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931968 00000100:00100000:3.0:1784404781.965395:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931968 00000100:00100000:3.0:1784404781.965411:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1784404781.965419:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728931584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965472:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728931584:12345-0@lo:400:kworker.0 Request processed in 53us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.965480:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1784404781.965504:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784404781.965510:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728932096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965537:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728932096:12345-0@lo:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.965543:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784404781.965554:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784404781.965559:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728931968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965595:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728931968:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.965601:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784404781.965621:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931456 00000100:00100000:3.0:1784404781.965625:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931456 00000100:00100000:3.0:1784404781.965649:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784404781.965655:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728931456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965685:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728931456:12345-0@lo:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.965691:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1784404781.965717:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404781.965721:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404781.965749:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728931456:0@lo:400:kworker.0 00010000:00080000:3.0:1784404781.965763:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443db5180 x1871083728931968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404781.965773:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728931968:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965782:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728931584:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.965788:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728932096:0@lo:400:kworker.0 00000100:00100000:0.0:1784404781.966044:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728931200:0@lo:400:kworker.0 00000100:00100000:0.0:1784404781.966092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404781.966124:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728931712:0@lo:400:kworker.0 00000100:00100000:0.0:1784404781.966155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404781.966175:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728932224:0@lo:400:kworker.0 00000100:00100000:0.0:1784404781.966196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404781.966211:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784404781.966217:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728931328:0@lo:400:kworker.0 00000100:00100000:0.0:1784404781.966238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404781.966254:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728931840:0@lo:400:kworker.0 00000100:00100000:0.0:1784404781.966274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404781.966416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931200 00000100:00100000:3.0:1784404781.966422:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931200 00000100:00100000:3.0:1784404781.966462:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1784404781.966470:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728931200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.966511:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd581730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728931200:12345-0@lo:400:kworker.0 Request processed in 42us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.966517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1784404781.966544:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728932224 00000100:00100000:3.0:1784404781.966548:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728932224 00000100:00100000:3.0:1784404781.966574:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931328 00000100:00100000:3.0:1784404781.966576:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931328 00000100:00100000:3.0:1784404781.966590:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931840 00000100:00100000:3.0:1784404781.966592:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931840 00000100:00100000:3.0:1784404781.966606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784404781.966613:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728932224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.966642:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728932224:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.966647:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784404781.966659:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784404781.966664:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728931328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.966691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728931328:12345-0@lo:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.966696:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784404781.966708:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784404781.966714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728931840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.966740:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728931840:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404781.966753:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:3.0:1784404781.966776:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404781.966780:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404781.966800:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728931328:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.966810:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728931840:0@lo:400:kworker.0 00000100:00100000:3.0:1784404781.966817:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728931200:0@lo:400:kworker.0 00010000:00080000:3.0:1784404781.966826:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443db5c00 x1871083728932224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404781.966836:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728932224:0@lo:400:kworker.0 00000100:00100000:1.0:1784404781.967680:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728931712 00000100:00100000:1.0:1784404781.967686:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728931712 00000100:00100000:1.0:1784404781.967752:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784404781.967762:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728931712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404781.967819:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728931712:12345-0@lo:400:kworker.0 Request processed in 60us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404781.967825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784404781.967884:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728931712:0@lo:400:kworker.0 00010000:00010000:3.0:1784404782.338988:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404782.454166:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404782.454540:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707898752 00000100:00100000:3.0:1784404782.454551:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707898752 00000100:00080000:0.0:1784404782.454739:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404782.454784:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 153 00000100:00100000:3.0:1784404782.454796:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:12192:x1871083707898752:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404782.454816:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404782.454880:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73a3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.454969:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.454986:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.454997:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455028:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455035:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455041:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455090:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455097:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455104:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455109:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404782.455113:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455121:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455132:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:3.0:1784404782.455135:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404782.455139:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455145:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7978a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455164:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455170:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455175:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455180:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404782.455184:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455190:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455197:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd54955f800) 00010000:00010000:3.0:1784404782.455199:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404782.455202:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455207:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79791 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455236:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79783 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73a3 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455247:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:3.0:1784404782.455249:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404782.455259:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73a3 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.455269:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7e00, rc 0) 00000100:00100000:3.0:1784404782.455349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:12192:x1871083707898752:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 555us (1194us total) trans 0 rc 301/301 00000100:00100000:3.0:1784404782.455357:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 153 00000100:00100000:3.0:1784404782.469975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404782.471449:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707899008 00000100:00100000:0.0:1784404782.471467:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707899008 00000100:00100000:0.0:1784404782.471544:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:0.0:1784404782.471555:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+14:12192:x1871083707899008:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:0.0:1784404782.471610:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404782.471651:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031600/0x24b3e2e6dcd790d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71c7 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.471670:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:0.0:1784404782.471676:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404782.471744:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.471760:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.471770:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.471815:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.471828:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 5 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404782.471880:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443660000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728932352:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404782.472006:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404782.487013:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443660000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728932352:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404782.487045:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404782.487428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404782.488463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707899136 00000100:00100000:3.0:1784404782.488478:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707899136 00010000:00010000:3.0:1784404782.488553:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 6 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404782.488597:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:3.0:1784404782.488606:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707899136:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404782.488639:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404782.488648:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 6 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.488662:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 6 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.488688:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7395 expref: 6 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.488724:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:3.0:1784404782.488730:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.488739:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.488747:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.488777:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1784404782.488951:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404782.489771:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707899136:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1161us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404782.489782:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 78 00010000:00010000:3.0:1784404782.489823:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.489831:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.489882:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.489893:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.489902:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.490530:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.490545:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.490553:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404782.490569:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096b1b2d9 reply state 00000000dbc97c9b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.490579:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.490585:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404782.490587:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404782.490590:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784404782.490596:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784404782.490602:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.490607:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.492045:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.492063:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404782.492068:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.492078:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.492108:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd443416500) 00010000:00010000:3.0:1784404782.492111:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404782.492115:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.492122:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79798 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404782.492146:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096b1b2d9 reply state 00000000dbc97c9b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.492158:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.492167:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd54955f800) 00010000:00010000:3.0:1784404782.492170:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404782.492172:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784404782.492423:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:12192:x1871083707899008:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 20864us (22455us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1784404782.492433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 154 00000100:00100000:3.0:1784404782.632733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404782.634350:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707899264 00000100:00100000:1.0:1784404782.634365:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707899264 00000100:00100000:1.0:1784404782.634439:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 155 00000100:00100000:1.0:1784404782.634450:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+15:12200:x1871083707899264:12345-192.168.202.42@tcp:101:lctl.0 00010000:00010000:1.0:1784404782.634475:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404782.634497:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd797ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73aa expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.634557:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd797b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.634571:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd797b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.634600:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd797b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404782.634650:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784404782.634654:0:13543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404782.634678:0:13543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd797b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.634703:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd797ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73aa expref: 17 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.634724:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd797b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73aa expref: 16 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.634732:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:1.0:1784404782.634736:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784404782.634739:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758200, rc 0) 00000100:00100000:1.0:1784404782.634811:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:12200:x1871083707899264:12345-192.168.202.42@tcp:101:lctl.0 Request processed in 364us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404782.634818:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 155 00000100:00100000:0.0:1784404782.724698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404782.724975:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707899392 00000100:00100000:3.0:1784404782.724986:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707899392 00000100:00100000:3.0:1784404782.725056:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 156 00000100:00100000:3.0:1784404782.725067:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+16:12206:x1871083707899392:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404782.725086:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404782.725105:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73b1 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725191:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725206:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725217:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725228:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725235:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725241:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725326:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd797d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725334:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd797d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725341:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd797d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404782.725375:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1784404782.725379:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404782.725415:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd797d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725439:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725445:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725452:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725458:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404782.725463:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725470:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725484:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:3.0:1784404782.725487:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404782.725491:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725498:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725511:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725518:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725524:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725537:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404782.725539:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725545:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725552:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd54955f800) 00010000:00010000:3.0:1784404782.725554:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404782.725557:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725562:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725587:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b1 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725598:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd797d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b1 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.725604:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404782.725606:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784404782.725609:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7c00, rc 0) 00000100:00100000:3.0:1784404782.725679:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:12206:x1871083707899392:12345-192.168.202.42@tcp:101:bash.0 Request processed in 614us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404782.725687:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 156 00000100:00100000:2.0:1784404782.730463:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404782.730554:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707899648 00000100:00100000:3.0:1784404782.730581:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707899648 00000100:00100000:3.0:1784404782.730665:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 157 00000100:00100000:3.0:1784404782.730681:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+17:12206:x1871083707899648:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404782.730710:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404782.730733:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd797d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73b8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.730917:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.730944:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.730959:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.730976:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.730983:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.730990:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784404782.731339:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1784404782.731494:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731504:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731523:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731558:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731566:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731573:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731579:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404782.731584:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731591:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731603:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404782.731606:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404782.731612:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731618:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd797de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404782.731632:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000580df5e5 reply state 00000000d22b90ab transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731643:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731655:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:3.0:1784404782.731657:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404782.731660:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784404782.731695:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd797d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731711:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.731718:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404782.731720:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404782.731722:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6600, rc 0) 00000100:00100000:3.0:1784404782.731789:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:12206:x1871083707899648:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1112us (1336us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1784404782.731797:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 157 00000100:00100000:1.0:1784404782.736925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404782.737021:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707899776 00000100:00100000:0.0:1784404782.737032:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707899776 00000100:00100000:0.0:1784404782.737108:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:0.0:1784404782.737119:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707899776:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404782.737136:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404782.737157:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73bf expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784404782.737182:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404782.737203:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1784404782.737208:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404782.737217:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.737236:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.737265:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a400, rc 0) 00000100:00100000:0.0:1784404782.737480:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2401:x1871083707899776:12345-192.168.202.42@tcp:101:bash.0 Request processed in 362us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404782.737487:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00080000:3.0:1784404782.737744:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404782.740790:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404782.741152:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707899904 00000100:00100000:1.0:1784404782.741163:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707899904 00000100:00100000:1.0:1784404782.741266:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:1.0:1784404782.741278:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:12206:x1871083707899904:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404782.741299:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404782.741318:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73c6 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.741364:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.741374:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404782.741378:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404782.741384:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 7 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.741420:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404782.741435:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 7 pid: 8433 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404782.741450:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8488:1871083728932480:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404782.741563:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712900 going to sleep for 11 seconds 00000100:00100000:1.0:1784404782.745739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404782.745926:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8488:1871083728932480:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404782.745975:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 7 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.745996:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759c00, rc 0) 00000100:00100000:0.0:1784404782.746050:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:12206:x1871083707899904:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4774us (5274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404782.746059:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:3.0:1784404782.746144:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707900032 00000100:00100000:3.0:1784404782.746157:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707900032 00010000:00010000:3.0:1784404782.746200:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 7 pid: 8433 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404782.746239:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:3.0:1784404782.746250:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707900032:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404782.746265:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404782.746290:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 7 pid: 8433 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.746326:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 7 pid: 8433 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.746352:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089f3293d/0x24b3e2e6dcd797fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73bf expref: 7 pid: 8433 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.746367:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404782.746372:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404782.746381:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.746391:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.746425:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404782.746439:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1871083728932608:192.168.202.42@tcp:105: 00000100:00100000:3.0:1784404782.746494:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548556600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404782.749028:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1871083728932608:192.168.202.42@tcp:105: 00010000:00010000:1.0:1784404782.749056:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404782.749123:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707900032:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 2874us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404782.749135:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 79 00000100:00100000:1.0:1784404782.754487:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404782.754588:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707900288 00000100:00100000:2.0:1784404782.754598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707900288 00000100:00100000:2.0:1784404782.754663:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:2.0:1784404782.754673:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:12206:x1871083707900288:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:2.0:1784404782.755019:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:12206:x1871083707900288:12345-192.168.202.42@tcp:35:bash.0 Request processed in 346us (539us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1784404782.755027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:2.0:1784404782.867038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404782.867124:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707900544 00000100:00100000:3.0:1784404782.867134:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707900544 00000100:00100000:3.0:1784404782.867207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 158 00000100:00100000:3.0:1784404782.867219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:12216:x1871083707900544:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404782.867243:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404782.867281:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73cd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404782.867395:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784404782.867493:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79808 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73cd expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.867506:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:3.0:1784404782.867509:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404782.867514:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73cd expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.867526:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6400, rc 0) 00000100:00100000:3.0:1784404782.867582:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:12216:x1871083707900544:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 366us (553us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1784404782.867588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 158 00000100:00100000:1.0:1784404782.873831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404782.874040:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707900800 00000100:00100000:2.0:1784404782.874051:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707900800 00000100:00100000:2.0:1784404782.874113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:2.0:1784404782.874124:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:12216:x1871083707900800:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404782.874368:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:12216:x1871083707900800:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 245us (546us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1784404782.874383:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:1.0:1784404782.932994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404782.937773:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707900928 00000100:00100000:0.0:1784404782.937789:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707900928 00000100:00100000:0.0:1784404782.937884:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:0.0:1784404782.937896:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:12222:x1871083707900928:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404782.937918:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404782.937949:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.938018:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7981d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.938034:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7981d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.938062:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7981d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404782.938110:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784404782.938114:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404782.938132:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7981d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.938157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73d4 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.938175:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7981d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73d4 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.938183:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404782.938186:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404782.938190:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a600, rc 0) 00000100:00100000:0.0:1784404782.938696:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd442554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:12222:x1871083707900928:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 799us (5711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404782.938705:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:1.0:1784404782.949058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404782.949171:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707901184 00000100:00100000:3.0:1784404782.949183:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707901184 00000100:00100000:3.0:1784404782.949253:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:3.0:1784404782.949264:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:12222:x1871083707901184:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404782.949289:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404782.949313:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79824 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73db expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.949426:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7982b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.949442:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7982b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.949469:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7982b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404782.949483:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784404782.949603:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79824 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73db expref: 27 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.949744:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7982b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73db expref: 26 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.949753:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404782.949756:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404782.949760:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6a00, rc 0) 00000100:00100000:3.0:1784404782.949917:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:12222:x1871083707901184:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 654us (872us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1784404782.949925:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:1.0:1784404782.954516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404782.954582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404782.954643:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707901440 00000100:00100000:0.0:1784404782.954656:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707901440 00000100:00100000:0.0:1784404782.954726:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:0.0:1784404782.954741:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:12222:x1871083707901440:12345-192.168.202.42@tcp:101:lfs.0 00000100:00100000:3.0:1784404782.954751:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707901568 00000100:00100000:3.0:1784404782.954755:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707901568 00010000:00010000:0.0:1784404782.954765:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404782.954785:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79839 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73e2 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404782.954795:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1784404782.954802:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:2404:x1871083707901568:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404782.954814:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404782.954841:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd7982b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73db expref: 28 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.954890:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404782.954897:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404782.954970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:2404:x1871083707901568:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 168us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404782.954978:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00010000:00010000:0.0:1784404782.955346:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79840 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.955360:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79840 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.955371:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79840 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404782.955383:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784404782.955678:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79839 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73e2 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.955695:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79840 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73e2 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.955702:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:0.0:1784404782.955705:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784404782.955708:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b400, rc 0) 00000100:00100000:0.0:1784404782.955755:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12222:x1871083707901440:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1016us (1249us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1784404782.955762:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:1.0:1784404782.964273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404782.964383:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707901696 00000100:00100000:2.0:1784404782.964394:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707901696 00000100:00100000:2.0:1784404782.964468:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:2.0:1784404782.964479:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2404:x1871083707901696:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:2.0:1784404782.964529:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.964552:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.964561:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404782.964565:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784404782.964571:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.964611:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.964640:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 6 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404782.964657:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1871083728932736:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404782.964755:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4434789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404782.968338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404782.968461:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1871083728932736:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404782.968505:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404782.968577:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707901824 00000100:00100000:3.0:1784404782.968584:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707901824 00002000:00100000:3.0:1784404782.968695:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9dd443cdd880 x1871083707901824/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:43/0 lens 504/0 e 0 to 0 dl 1784404793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784404782.968705:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443cdd880 with x1871083707901824 ext(0->12) 00010000:00010000:3.0:1784404782.968713:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 7 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.968728:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 7 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404782.968736:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd443cdd880 00000100:00100000:3.0:1784404782.968833:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:3.0:1784404782.968891:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707901824:12345-192.168.202.42@tcp:4:lfs.0 00000100:00100000:3.0:1784404782.970063:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707901824:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 1204us (1731us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784404782.970074:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00002000:00100000:3.0:1784404782.970093:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9dd443cdd880 x1871083707901824/t4294967306(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:43/0 lens 504/448 e 0 to 0 dl 1784404793 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784404782.970102:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443cdd880 with x1871083707901824 ext(0->12) 00010000:00010000:3.0:1784404782.970110:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 9 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.970138:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 9 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404782.970147:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd443cdd880 00000100:00100000:1.0:1784404782.972954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404782.973209:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707901952 00000100:00100000:0.0:1784404782.973219:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707901952 00010000:00010000:0.0:1784404782.973256:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 9 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404782.973297:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:0.0:1784404782.973320:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2402:x1871083707901952:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404782.973337:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784404782.973356:0:10336:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784404782.973359:0:10336:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784404783 00002000:00010000:0.0:1784404782.973362:0:10336:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784404783 00002000:00010000:0.0:1784404782.973364:0:10336:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1784404783 00002000:00010000:0.0:1784404782.973367:0:10336:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784404782.973373:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 9 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.973388:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 9 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.973411:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e85be4/0x24b3e2e6dcd79801 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73c6 expref: 9 pid: 8488 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.973427:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404782.973431:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404782.973437:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.973447:0:10336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.973484:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404782.973543:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2402:x1871083707901952:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 224us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404782.973560:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 80 00010000:00010000:2.0:1784404782.974443:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974456:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974480:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974489:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974497:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974504:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404782.974509:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974518:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974534:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.974553:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d318366/0x24b3e2e6dcd7984e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404782.974636:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707901696:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 10157us (10371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404782.974645:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:1.0:1784404782.984447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404782.984536:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707902208 00000100:00100000:2.0:1784404782.984549:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707902208 00000100:00100000:2.0:1784404782.984619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:2.0:1784404782.984632:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12222:x1871083707902208:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:2.0:1784404782.984718:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79840 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73e2 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784404782.984991:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1784404782.985028:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1784404782.985370:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1784404782.985412:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.985429:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.985438:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.985478:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.985514:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 31 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404782.985531:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728932864:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404782.985627:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4434789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404782.989050:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728932864:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404782.989085:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404782.990558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404782.990754:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707902336 00000100:00100000:3.0:1784404782.990762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707902336 00010000:00010000:3.0:1784404782.990794:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 32 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404782.990828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:3.0:1784404782.990847:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:2403:x1871083707902336:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404782.990890:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404782.990897:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 32 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.990910:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 32 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.990929:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd797ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b8 expref: 32 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.990955:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404782.990961:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.990970:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.990993:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404782.991026:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404782.991551:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.991561:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784404782.991708:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1784404782.991798:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1784404782.992192:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728932992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784404782.992259:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404782.992307:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478180 going to sleep for 11 seconds 00000100:00100000:3.0:1784404782.992535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+33:2403:x1871083707902336:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1694us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404782.992546:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:1.0:1784404782.992890:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728932992 00000100:00100000:1.0:1784404782.992898:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728932992 00000100:00100000:1.0:1784404782.992958:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784404782.992967:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1871083728932992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404782.993071:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1871083728932992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404782.993078:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784404782.993335:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728932992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784404782.993484:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1784404782.993555:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728933120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784404782.993592:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404782.993693:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404782.993747:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728933120 00000100:00100000:1.0:1784404782.993752:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728933120 00000100:00100000:1.0:1784404782.993788:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784404782.993796:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1871083728933120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404782.994066:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1871083728933120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 270us (473us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784404782.994074:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784404782.994185:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728933120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784404782.994233:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1784404782.994268:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.994276:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.994297:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.994302:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404782.994305:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.994311:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.994323:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:2.0:1784404782.994324:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784404782.994327:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404782.994331:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79855 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784404782.994402:0:6522:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784404782.994465:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1784404782.994476:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400878624146ns, next at 401878622074ns, rc = 0 00000001:00080000:2.0:1784404782.994483:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1784404782.994507:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:2.0:1784404782.994510:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784404782.994516:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79840 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73e2 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404782.994609:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:12222:x1871083707902208:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 9979us (10172us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1784404782.994686:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000020:00080000:2.0:1784404782.994689:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784404782.996958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404782.997028:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707902464 00000100:00100000:0.0:1784404782.997035:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707902464 00000100:00100000:0.0:1784404782.997107:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:0.0:1784404782.997116:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:12222:x1871083707902464:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404782.997135:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404782.997155:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7985c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73e9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.997202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7985c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73e9 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.997213:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7985c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73e9 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404782.997225:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:0.0:1784404782.997228:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784404782.997230:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:0.0:1784404782.997274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:12222:x1871083707902464:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 160us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404782.997279:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:2.0:1784404783.000843:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404783.000951:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707902720 00000100:00100000:3.0:1784404783.000966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707902720 00000100:00100000:2.0:1784404783.001091:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:2.0:1784404783.001102:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:12222:x1871083707902720:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404783.001293:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+36:12222:x1871083707902720:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 192us (460us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1784404783.001301:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000040:00080000:3.0:1784404783.107562:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784404783.129105:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404783.129285:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707902976 00000100:00100000:1.0:1784404783.129295:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707902976 00000100:00100000:1.0:1784404783.129359:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 163 00000100:00100000:1.0:1784404783.129370:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+36:12232:x1871083707902976:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404783.129421:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404783.129442:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79863 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73f0 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404783.129548:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784404783.129642:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79863 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f0 expref: 38 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404783.129659:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:1.0:1784404783.129662:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784404783.129666:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758800/0x24b3e2e6dcd79863 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f0 expref: 38 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404783.129682:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758800, rc 0) 00000100:00100000:1.0:1784404783.129748:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12232:x1871083707902976:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 381us (654us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1784404783.129755:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 163 00000100:00100000:2.0:1784404783.152789:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404783.153147:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707903104 00000100:00100000:0.0:1784404783.153229:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707903104 00000100:00100000:0.0:1784404783.153545:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:0.0:1784404783.153557:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12232:x1871083707903104:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:0.0:1784404783.153644:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153674:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153689:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153701:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153707:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153712:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153787:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153795:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153802:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784404783.153878:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153890:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153894:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153907:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153910:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404783.153913:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153918:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153926:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404783.153941:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404783.153945:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153952:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79871 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153964:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153970:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153975:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153979:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404783.153982:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.153998:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154007:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:0.0:1784404783.154009:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404783.154012:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154018:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79878 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154027:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154032:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154037:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154042:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151bc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404783.154045:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154049:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154056:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:0.0:1784404783.154058:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404783.154061:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.154076:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7987f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404783.156665:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12232:x1871083707903104:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 1919us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404783.156686:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:0.0:1784404783.171205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404783.173531:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707903360 00000100:00100000:2.0:1784404783.173546:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707903360 00000100:00100000:2.0:1784404783.173628:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:2.0:1784404783.173640:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12232:x1871083707903360:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404783.173920:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:12232:x1871083707903360:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 281us (2724us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1784404783.174146:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:3.0:1784404783.258200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404783.258303:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707903616 00000100:00100000:0.0:1784404783.258315:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707903616 00000100:00100000:0.0:1784404783.258380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:0.0:1784404783.258391:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:12235:x1871083707903616:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404783.258416:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404783.258436:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79886 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.258757:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.258775:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.258789:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.258800:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.258806:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259101:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259242:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259250:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259258:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404783.259270:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784404783.259359:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259367:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259373:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259379:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404783.259383:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259389:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259400:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404783.259404:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404783.259415:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259422:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7988d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259436:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259442:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259447:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259451:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404783.259454:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259460:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259467:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:0.0:1784404783.259470:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404783.259473:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259479:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79894 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259736:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79886 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259763:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.259770:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:0.0:1784404783.259772:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404783.259775:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ae00, rc 0) 00000100:00100000:0.0:1784404783.260443:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:12235:x1871083707903616:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 2050us (2250us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1784404783.260453:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 165 00000100:00100000:1.0:1784404783.267430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404783.267551:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707903744 00000100:00100000:2.0:1784404783.267561:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707903744 00000100:00100000:2.0:1784404783.267626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:2.0:1784404783.267637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:12235:x1871083707903744:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1784404783.267723:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267743:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267771:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267809:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267816:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267823:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267829:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ec00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404783.267833:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267840:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267901:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404783.267905:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404783.267911:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.267917:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd798a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404783.268146:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:12235:x1871083707903744:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 511us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404783.268155:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:2.0:1784404783.277182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404783.277396:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707904000 00000100:00100000:0.0:1784404783.277406:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707904000 00000100:00100000:0.0:1784404783.277462:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:0.0:1784404783.277473:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:12235:x1871083707904000:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1784404783.277729:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+41:12235:x1871083707904000:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 257us (556us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1784404783.277736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00010000:00010000:0.0:1784404783.367749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404783.491496:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728933248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404783.491566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404783.492973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728933248 00000100:00100000:2.0:1784404783.492987:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728933248 00000100:00100000:2.0:1784404783.493069:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784404783.493080:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728933248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404783.493120:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784404783.493214:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728933248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404783.493223:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784404783.493388:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728933248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404783.638015:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404783.638157:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707904256 00000100:00100000:3.0:1784404783.638169:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707904256 00000100:00100000:3.0:1784404783.638236:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00100000:3.0:1784404783.638246:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+41:12266:x1871083707904256:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:3.0:1784404783.638271:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404783.638291:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd798b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed73fe expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.638414:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd798b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.638443:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd798b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.638454:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd798b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404783.638466:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784404783.638571:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd798b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73fe expref: 44 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.638586:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd798b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73fe expref: 43 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.638592:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404783.638594:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404783.638597:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6a00, rc 0) 00000100:00100000:3.0:1784404783.638709:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:12266:x1871083707904256:12345-192.168.202.42@tcp:101:cat.0 Request processed in 464us (702us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1784404783.638714:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 167 00000100:00100000:1.0:1784404783.646769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404783.646824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404783.646964:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707904512 00000100:00100000:0.0:1784404783.646976:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707904512 00000100:00100000:0.0:1784404783.647048:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:0.0:1784404783.647058:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:12266:x1871083707904512:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:0.0:1784404783.647306:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:12266:x1871083707904512:12345-192.168.202.42@tcp:35:cat.0 Request processed in 248us (547us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1784404783.647331:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:2.0:1784404783.647782:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707904640 00000100:00100000:2.0:1784404783.647787:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707904640 00000100:00100000:2.0:1784404783.647832:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:2.0:1784404783.647840:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:2401:x1871083707904640:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404783.647878:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404783.647903:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd798b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73fe expref: 44 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.647921:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404783.647937:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404783.647976:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:2401:x1871083707904640:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 138us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404783.647984:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1784404783.705035:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404783.705179:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707904896 00000100:00100000:0.0:1784404783.705190:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707904896 00000100:00100000:0.0:1784404783.705248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:0.0:1784404783.705257:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:12272:x1871083707904896:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:0.0:1784404783.705278:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404783.705280:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784404783.705306:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7981d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73d4 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.705323:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404783.705326:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404783.705336:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd798c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7405 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.705574:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.705598:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.705603:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.705716:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.705726:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 43 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404783.705752:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728933376:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404783.705962:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404783.715314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404783.715508:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443660e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728933376:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404783.715544:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404783.716007:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707905024 00000100:00100000:2.0:1784404783.716015:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707905024 00010000:00010000:2.0:1784404783.716059:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 44 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404783.716185:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:2.0:1784404783.716213:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570559850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:2404:x1871083707905024:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404783.716233:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404783.716242:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 44 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.716257:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 44 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.716284:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd7989b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73f7 expref: 44 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.716302:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404783.716307:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.716316:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.716325:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.716439:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404783.716744:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570559850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:2404:x1871083707905024:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 531us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404783.716754:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 82 00010000:00010000:0.0:1784404783.717005:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.717014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404783.717035:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784404783.717209:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd798c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.717229:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404783.717238:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:0.0:1784404783.717240:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404783.717243:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a800, rc 0) 00000100:00100000:0.0:1784404783.717281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:12272:x1871083707904896:12345-192.168.202.42@tcp:101:dd.0 Request processed in 12024us (12259us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1784404783.717289:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:1.0:1784404783.724208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404783.724422:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707905152 00000100:00100000:3.0:1784404783.724432:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707905152 00000100:00100000:3.0:1784404783.724495:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:3.0:1784404783.724507:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:12272:x1871083707905152:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:3.0:1784404783.724546:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404783.724565:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd798da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed740c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.724594:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.724608:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.724627:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.724729:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd798da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.724745:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.724751:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404783.724754:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784404783.724756:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6400, rc 0) 00000100:00100000:3.0:1784404783.724815:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:12272:x1871083707905152:12345-192.168.202.42@tcp:101:dd.0 Request processed in 311us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404783.724822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 169 00000100:00100000:1.0:1784404783.730539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404783.730642:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707905408 00000100:00100000:3.0:1784404783.730655:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707905408 00000100:00100000:3.0:1784404783.730720:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:3.0:1784404783.730731:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:12272:x1871083707905408:12345-192.168.202.42@tcp:36:dd.0 00010000:00010000:3.0:1784404783.731058:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.731079:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.731090:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784404783.731137:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1784404783.731161:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020c1deee reply state 000000006df84dac transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.731173:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.731181:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404783.731184:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404783.731189:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404783.731307:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+47:12272:x1871083707905408:12345-192.168.202.42@tcp:36:dd.0 Request processed in 577us (778us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1784404783.731316:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 170 00000020:00080000:3.0:1784404783.731321:0:13543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1784404783.811185:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784404783.811197:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784404783.811306:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1784404783.811313:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784404783.967388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404783.967552:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707905536 00000100:00100000:3.0:1784404783.967563:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707905536 00000100:00100000:3.0:1784404783.967626:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 171 00000100:00100000:3.0:1784404783.967637:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+47:12286:x1871083707905536:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:3.0:1784404783.967663:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404783.967687:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd798ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7413 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967780:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967796:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967808:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967830:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967840:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967847:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967974:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.967982:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.968016:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.968043:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 48 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404783.968059:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728933504:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404783.968237:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78000 going to sleep for 11 seconds 00000100:00100000:1.0:1784404783.972697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404783.972736:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728933504:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404783.972766:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404783.972815:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707905792 00000100:00100000:0.0:1784404783.973029:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707905792 00000100:00100000:0.0:1784404783.973162:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:0.0:1784404783.973174:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+49:6170:x1871083707905792:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784404783.973662:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:6170:x1871083707905792:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 488us (975us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1784404783.973671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:1.0:1784404783.976044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404783.976227:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707905920 00000100:00100000:2.0:1784404783.976238:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707905920 00010000:00010000:2.0:1784404783.976279:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 50 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404783.976368:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:2.0:1784404783.976380:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:2404:x1871083707905920:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404783.976397:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404783.976405:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 50 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.976419:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 50 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.976442:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd798cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7405 expref: 50 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.976459:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404783.976464:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.976474:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.976482:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404783.976515:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404783.976560:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976568:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404783.976573:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+49:2404:x1871083707905920:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 196us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404783.976587:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 83 00000004:00200000:3.0:1784404783.976629:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784404783.976634:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404783.976653:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976667:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976676:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976682:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976698:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976704:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404783.976708:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976714:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976723:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404783.976726:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404783.976730:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976736:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd798f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976747:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976753:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976757:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976761:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404783.976764:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976778:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:3.0:1784404783.976789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404783.976791:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976797:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd798fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976825:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd798ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7413 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976840:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7413 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404783.976847:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404783.976894:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404783.976898:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7200, rc 0) 00000100:00100000:3.0:1784404783.976943:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+48:12286:x1871083707905536:12345-192.168.202.42@tcp:101:stat.0 Request processed in 9307us (9569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404783.976950:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 171 00000100:00100000:1.0:1784404784.042016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.042176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707906176 00000100:00100000:3.0:1784404784.042187:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707906176 00000100:00100000:3.0:1784404784.042273:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 172 00000100:00100000:3.0:1784404784.042286:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+48:12292:x1871083707906176:12345-192.168.202.42@tcp:36:truncate.0 00010000:00010000:3.0:1784404784.042377:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404784.042425:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7413 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.042446:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404784.042451:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404784.042672:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.042688:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.042699:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784404784.042744:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1784404784.042768:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7854c95 reply state 00000000ef04aa15 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.042780:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.042785:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404784.042788:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404784.042791:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404784.042960:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:12292:x1871083707906176:12345-192.168.202.42@tcp:36:truncate.0 Request processed in 677us (958us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1784404784.042968:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 172 00000020:00080000:3.0:1784404784.042973:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1784404784.043113:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404784.199663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.199778:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707906304 00000100:00100000:2.0:1784404784.199787:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707906304 00000100:00100000:2.0:1784404784.199886:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 173 00000100:00100000:2.0:1784404784.199898:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+50:12306:x1871083707906304:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:2.0:1784404784.199966:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404784.199992:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79912 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed741a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200061:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200085:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200100:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200113:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200120:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200127:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200205:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200226:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200247:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404784.200292:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1784404784.200296:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404784.200326:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200336:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200342:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200352:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200357:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200360:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.200363:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200368:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200380:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404784.200386:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.200391:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200397:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79919 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200412:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200418:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200424:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200429:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ee00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.200432:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200438:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200446:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:2.0:1784404784.200449:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.200452:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200456:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79920 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200476:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd79912 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200494:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.200499:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404784.200501:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404784.200503:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f600, rc 0) 00000100:00100000:2.0:1784404784.200559:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+51:12306:x1871083707906304:12345-192.168.202.42@tcp:101:stat.0 Request processed in 665us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.200563:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 173 00000100:00100000:1.0:1784404784.273659:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.274198:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707906560 00000100:00100000:3.0:1784404784.274210:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707906560 00000100:00100000:3.0:1784404784.274278:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:3.0:1784404784.274289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+51:12316:x1871083707906560:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404784.274313:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404784.274335:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd7992e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7421 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404784.274442:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784404784.274556:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd7992e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7421 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.274571:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:3.0:1784404784.274574:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404784.274579:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd7992e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7421 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.274593:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7200, rc 0) 00000100:00100000:3.0:1784404784.274665:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:12316:x1871083707906560:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 376us (1014us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1784404784.274673:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 174 00000100:00100000:1.0:1784404784.278113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.278210:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707906816 00000100:00100000:3.0:1784404784.278220:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707906816 00000100:00100000:3.0:1784404784.278320:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:3.0:1784404784.278331:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd548289050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:12316:x1871083707906816:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1784404784.278550:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd548289050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+53:12316:x1871083707906816:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 220us (446us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1784404784.278575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:2.0:1784404784.330264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.330326:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907072 00000100:00100000:3.0:1784404784.330335:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907072 00000100:00100000:3.0:1784404784.330397:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00100000:3.0:1784404784.330409:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+53:12322:x1871083707907072:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404784.330439:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404784.330459:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd7993c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7428 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.330547:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.330558:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.330565:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.330590:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.330599:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 54 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.330769:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728933632:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404784.330904:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78900 going to sleep for 11 seconds 00000100:00100000:1.0:1784404784.333295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.333396:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.333742:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907328 00000100:00100000:2.0:1784404784.333752:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907328 00000100:00100000:2.0:1784404784.333824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 303 00000100:00100000:2.0:1784404784.333835:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707907328:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404784.333958:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707907328:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 124us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.333967:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 303 00000100:00080000:2.0:1784404784.333992:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404784.334216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.334259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.334286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.334403:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907840 00000100:00100000:2.0:1784404784.334408:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907840 00000100:00100000:2.0:1784404784.334444:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 304 00000100:00100000:2.0:1784404784.334451:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707907840:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404784.334489:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707907840:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.334495:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 304 00000100:00080000:2.0:1784404784.334527:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404784.334707:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907200 00000100:00100000:0.0:1784404784.334712:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907200 00000100:00100000:0.0:1784404784.334753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 382 00000100:00100000:0.0:1784404784.334761:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707907200:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404784.334791:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707907200:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 32us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404784.334797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 382 00000100:00100000:1.0:1784404784.337637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.337745:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728933632:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404784.337773:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404784.338225:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907712 00000100:00100000:2.0:1784404784.338233:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907712 00000100:00100000:2.0:1784404784.338311:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 305 00000100:00100000:2.0:1784404784.338320:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707907712:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404784.338395:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707907712:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 75us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.338402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 305 00000100:00080000:1.0:1784404784.338884:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404784.342650:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907584 00000100:00100000:0.0:1784404784.342650:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907456 00000100:00100000:3.0:1784404784.342668:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907584 00000100:00100000:0.0:1784404784.342668:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907456 00000100:00100000:0.0:1784404784.342814:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:0.0:1784404784.342824:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707907456:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404784.342825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.342869:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707907968 00000100:00100000:1.0:1784404784.342873:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707907968 00010000:00010000:1.0:1784404784.342902:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 55 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404784.342944:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:1.0:1784404784.342952:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:2404:x1871083707907968:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404784.342969:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404784.342976:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 55 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.342991:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 55 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.343024:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed741a expref: 55 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.343043:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00000100:00100000:0.0:1784404784.343043:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707907456:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 220us (8755us total) trans 0 rc 0/0 00010000:00010000:1.0:1784404784.343048:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404784.343050:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 83 00010000:00010000:1.0:1784404784.343058:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.343130:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.343160:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404784.343179:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:2404:x1871083707907968:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 228us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404784.343185:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 84 00010000:00010000:1.0:1784404784.343214:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.343223:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404784.343240:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1784404784.343382:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd7993c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784404784.343536:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404784.343637:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:2.0:1784404784.343645:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707907584:12345-192.168.202.42@tcp:400:kworker.0 00010000:00010000:1.0:1784404784.343665:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404784.343681:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2403:x1871083707907584:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (10286us total) trans 0 rc 0/0 00010000:00010000:1.0:1784404784.343685:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:1.0:1784404784.343688:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784404784.343691:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6000, rc 0) 00000100:00100000:1.0:1784404784.343712:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:12322:x1871083707907072:12345-192.168.202.42@tcp:101:bash.0 Request processed in 13306us (13457us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1784404784.343719:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 175 00000100:00080000:0.0:1784404784.345932:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404784.347793:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:1.0:1784404784.348158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.348227:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707908224 00000100:00100000:2.0:1784404784.348237:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707908224 00000100:00100000:2.0:1784404784.348331:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 176 00000100:00100000:2.0:1784404784.348344:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:12322:x1871083707908224:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:2.0:1784404784.348595:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.348628:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.348641:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784404784.348685:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1784404784.348725:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048010bcc reply state 00000000375057ec transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.348738:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.348746:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404784.348748:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404784.348752:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404784.348905:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:12322:x1871083707908224:12345-192.168.202.42@tcp:36:bash.0 Request processed in 560us (744us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1784404784.348912:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 176 00000020:00080000:2.0:1784404784.348964:0:13543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784404784.355750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.355897:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707908352 00000100:00100000:2.0:1784404784.355908:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707908352 00000100:00100000:2.0:1784404784.356066:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 177 00000100:00100000:2.0:1784404784.356145:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:12322:x1871083707908352:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784404784.356172:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404784.356193:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79958 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed742f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.356282:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.356298:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.356306:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.356347:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.356370:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 58 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404784.356385:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728933760:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404784.356478:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478180 going to sleep for 11 seconds 00000100:00100000:1.0:1784404784.361167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.361397:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1871083728933760:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404784.361438:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.361512:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707908480 00000100:00100000:3.0:1784404784.361520:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707908480 00010000:00010000:3.0:1784404784.361555:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 59 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.361593:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 85 00000100:00100000:3.0:1784404784.361603:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:2404:x1871083707908480:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404784.361621:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404784.361628:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 59 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.361640:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 59 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.361665:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79943 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7428 expref: 59 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.361684:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404784.361688:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.361696:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.361702:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.361722:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404784.361746:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.361753:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.361780:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:2404:x1871083707908480:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 178us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.361804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 85 00000004:00200000:2.0:1784404784.361808:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784404784.361812:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404784.362678:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.362719:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79958 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed742f expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.362737:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed742f expref: 57 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.362744:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404784.362770:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404784.362773:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fe00, rc 0) 00000100:00100000:2.0:1784404784.362959:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:12322:x1871083707908352:12345-192.168.202.42@tcp:101:bash.0 Request processed in 6759us (7095us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.362969:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 177 00000100:00100000:0.0:1784404784.366693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.366779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707908736 00000100:00100000:2.0:1784404784.366790:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707908736 00000100:00100000:2.0:1784404784.366883:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:2.0:1784404784.366894:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+57:12322:x1871083707908736:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:2.0:1784404784.367160:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:12322:x1871083707908736:12345-192.168.202.42@tcp:35:bash.0 Request processed in 267us (476us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1784404784.367168:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00010000:00010000:0.0:1784404784.387509:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404784.458818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.458980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707908992 00000100:00100000:2.0:1784404784.458990:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707908992 00000100:00100000:2.0:1784404784.459047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 178 00000100:00100000:2.0:1784404784.459057:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:12333:x1871083707908992:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404784.459085:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404784.459107:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7436 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404784.459214:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784404784.459312:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79966 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7436 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.459325:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:2.0:1784404784.459328:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404784.459333:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7436 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.459360:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f200, rc 0) 00000100:00100000:2.0:1784404784.459425:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12333:x1871083707908992:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 368us (616us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1784404784.459432:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 178 00000100:00100000:1.0:1784404784.463411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.463487:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707909120 00000100:00100000:2.0:1784404784.463498:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707909120 00000100:00100000:2.0:1784404784.463570:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:2.0:1784404784.463580:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12333:x1871083707909120:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:2.0:1784404784.463666:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463683:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463696:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463708:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463716:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463723:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463793:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463828:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463843:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404784.463940:0:13543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463953:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463960:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463967:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463973:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.463978:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463985:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.463998:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404784.464001:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.464005:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464011:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79974 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464033:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464039:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464044:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464049:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.464052:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464059:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464066:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:2.0:1784404784.464068:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.464072:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464078:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd7997b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464087:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464092:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464097:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464107:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.464110:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464116:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464125:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404784.464127:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.464130:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.464136:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79982 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404784.464211:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12333:x1871083707909120:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 632us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.464220:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 179 00000100:00100000:1.0:1784404784.467303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.467392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707909376 00000100:00100000:3.0:1784404784.467403:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707909376 00000100:00100000:3.0:1784404784.467464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:3.0:1784404784.467475:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12333:x1871083707909376:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1784404784.467720:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:12333:x1871083707909376:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 246us (427us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1784404784.467729:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:1.0:1784404784.497963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.498045:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707909632 00000100:00100000:2.0:1784404784.498054:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707909632 00000100:00100000:2.0:1784404784.498113:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:2.0:1784404784.498124:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:12336:x1871083707909632:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404784.498149:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404784.498168:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79989 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed743d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498260:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498280:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498292:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498311:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498318:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498409:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd7999e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498416:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd7999e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498422:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd7999e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404784.498431:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784404784.498502:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498508:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498512:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498521:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.498524:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498529:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498537:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404784.498539:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.498542:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498546:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79990 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498554:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498557:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498561:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498564:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.498565:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498569:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498578:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:2.0:1784404784.498580:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.498582:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498585:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79997 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498622:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79989 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed743d expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498632:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd7999e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed743d expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.498636:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404784.498637:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404784.498639:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f200, rc 0) 00000100:00100000:2.0:1784404784.498685:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:12336:x1871083707909632:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 565us (731us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1784404784.498690:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 180 00000100:00100000:1.0:1784404784.501273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.501352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.501411:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707909760 00000100:00100000:3.0:1784404784.501419:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707909760 00000100:00100000:3.0:1784404784.501478:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:3.0:1784404784.501489:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:2404:x1871083707909760:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404784.501502:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404784.501522:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd7999e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed743d expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.501536:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404784.501539:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404784.501586:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:2404:x1871083707909760:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.501591:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1784404784.502500:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707909888 00000100:00100000:0.0:1784404784.502507:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707909888 00000100:00100000:0.0:1784404784.502574:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:0.0:1784404784.502580:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:12336:x1871083707909888:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1784404784.502642:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502668:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502677:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502707:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502712:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502717:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502720:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404784.502723:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502728:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502734:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:0.0:1784404784.502736:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404784.502739:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.502743:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404784.502793:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:12336:x1871083707909888:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 214us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404784.502804:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 181 00000100:00100000:1.0:1784404784.504696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.504808:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707910144 00000100:00100000:3.0:1784404784.504817:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707910144 00000100:00100000:3.0:1784404784.504902:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:3.0:1784404784.504912:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+61:12336:x1871083707910144:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1784404784.505180:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:12336:x1871083707910144:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 269us (490us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1784404784.505189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:1.0:1784404784.515137:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404784.515161:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728933888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404784.515231:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404784.515360:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728933888 00000100:00100000:2.0:1784404784.515368:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728933888 00000100:00100000:2.0:1784404784.515419:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784404784.515427:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728933888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404784.515458:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784404784.515505:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728933888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.515526:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784404784.515655:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728933888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404784.643745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404784.643895:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707910400 00000100:00100000:0.0:1784404784.643905:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707910400 00000100:00100000:0.0:1784404784.643982:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:0.0:1784404784.643994:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+62:12354:x1871083707910400:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:0.0:1784404784.644024:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404784.644048:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7444 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.644183:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd799ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.644201:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd799ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.644215:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd799ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404784.644228:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784404784.644360:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd799b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7444 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.644382:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd799ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7444 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.644402:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:0.0:1784404784.644423:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784404784.644427:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b400, rc 0) 00000100:00100000:0.0:1784404784.644498:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12354:x1871083707910400:12345-192.168.202.42@tcp:101:cat.0 Request processed in 506us (763us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1784404784.644504:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 182 00000100:00100000:1.0:1784404784.677246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.677373:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707910528 00000100:00100000:2.0:1784404784.677383:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707910528 00000100:00100000:2.0:1784404784.677548:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 183 00000100:00100000:2.0:1784404784.677560:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12355:x1871083707910528:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404784.677583:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404784.677602:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed744b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.677680:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd799cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.677694:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd799cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.677706:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd799cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404784.677750:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784404784.677754:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404784.677773:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd799cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.677798:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed744b expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.677830:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd799cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed744b expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.677934:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404784.677937:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784404784.677941:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f600, rc 0) 00000100:00100000:2.0:1784404784.678061:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12355:x1871083707910528:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 503us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.678079:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 183 00000100:00100000:2.0:1784404784.685234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.685349:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707910912 00000100:00100000:3.0:1784404784.685360:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707910912 00000100:00100000:3.0:1784404784.685515:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:3.0:1784404784.685528:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12355:x1871083707910912:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1784404784.686339:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12355:x1871083707910912:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 810us (1113us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1784404784.686348:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:0.0:1784404784.689512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.689667:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707911040 00000100:00100000:2.0:1784404784.689678:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707911040 00000100:00100000:2.0:1784404784.689790:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:2.0:1784404784.689802:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12355:x1871083707911040:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:2.0:1784404784.690057:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784404784.690160:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd7995f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed742f expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.690187:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd799ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7444 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.690199:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7985c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73e9 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.690208:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404784.690214:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404784.690282:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12355:x1871083707911040:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 483us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.690308:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:1.0:1784404784.692954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404784.693098:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707911168 00000100:00100000:0.0:1784404784.693108:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707911168 00000100:00100000:0.0:1784404784.693173:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:0.0:1784404784.693185:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12355:x1871083707911168:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:0.0:1784404784.693316:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.693335:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404784.693346:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784404784.693453:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1784404784.693540:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12355:x1871083707911168:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 358us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404784.693549:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 184 00000100:00100000:1.0:1784404784.724973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.725077:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707911296 00000100:00100000:2.0:1784404784.725092:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707911296 00000100:00100000:2.0:1784404784.725160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 185 00000100:00100000:2.0:1784404784.725170:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12357:x1871083707911296:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404784.725190:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404784.725212:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd799dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7452 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725275:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725291:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725303:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725314:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725322:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725328:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725401:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725428:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725436:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404784.725477:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784404784.725482:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404784.725501:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725513:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725521:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725527:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725533:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725539:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.725542:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725549:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725562:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404784.725565:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.725577:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725584:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd799e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725598:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725604:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725609:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725615:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404784.725618:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725623:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725631:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:2.0:1784404784.725633:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404784.725636:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725641:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd799eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725668:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd799dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725694:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.725701:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404784.725703:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784404784.725706:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e600, rc 0) 00000100:00100000:2.0:1784404784.725782:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12357:x1871083707911296:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 612us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.725789:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 185 00000040:00080000:2.0:1784404784.835061:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784404784.835071:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784404784.835100:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784404784.835109:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784404784.835253:0:13786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728934016:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784404784.835363:0:13786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4434780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404784.845006:0:13786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728934016:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784404784.849773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.850495:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707911424 00000100:00100000:1.0:1784404784.850508:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707911424 00000100:00100000:1.0:1784404784.850581:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:1.0:1784404784.850610:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12368:x1871083707911424:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784404784.850647:0:6520:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784404784.850775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12368:x1871083707911424:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 175us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404784.850784:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 186 00000100:00100000:1.0:1784404784.869602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.869756:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707911552 00000100:00100000:3.0:1784404784.869767:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707911552 00000100:00100000:3.0:1784404784.869845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:3.0:1784404784.869881:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12368:x1871083707911552:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784404784.869977:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.869995:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870008:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870060:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870080:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870087:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870116:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870124:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870131:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404784.870175:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784404784.870179:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404784.870191:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870203:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870209:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870216:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870222:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404784.870226:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870240:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870253:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:3.0:1784404784.870256:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404784.870261:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870267:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd799f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870278:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870283:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870288:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870293:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404784.870295:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870300:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870306:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9dd54955ff00) 00010000:00010000:3.0:1784404784.870308:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404784.870310:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870325:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a00 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870338:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870343:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870348:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870352:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404784.870355:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870359:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870365:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404784.870367:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404784.870370:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.870375:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.870439:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12368:x1871083707911552:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 562us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.870447:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 187 00000100:00100000:1.0:1784404784.873440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.873524:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707911808 00000100:00100000:3.0:1784404784.873534:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707911808 00000100:00100000:3.0:1784404784.873592:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:3.0:1784404784.873699:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12368:x1871083707911808:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404784.873723:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404784.873747:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79a0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7459 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874131:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874148:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874161:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404784.874173:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784404784.874275:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874283:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874291:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874297:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404784.874302:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874309:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874339:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:3.0:1784404784.874342:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404784.874347:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874354:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874403:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79a0e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7459 expref: 66 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874415:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:3.0:1784404784.874417:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404784.874421:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79a0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7459 expref: 66 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.874432:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7200, rc 0) 00000100:00100000:3.0:1784404784.874496:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12368:x1871083707911808:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 895us (1065us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1784404784.874504:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 188 00000100:00100000:3.0:1784404784.879465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404784.879568:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707911936 00000100:00100000:0.0:1784404784.879579:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707911936 00000100:00100000:0.0:1784404784.879651:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:0.0:1784404784.879663:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12368:x1871083707911936:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784404784.879698:0:9527:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784404784.879848:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12368:x1871083707911936:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 186us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404784.879888:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 189 00000100:00100000:1.0:1784404784.892354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.896731:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707912192 00000100:00100000:3.0:1784404784.896746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707912192 00000100:00100000:3.0:1784404784.896998:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:3.0:1784404784.897012:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12368:x1871083707912192:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404784.897035:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404784.897038:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784404784.897074:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd799cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed744b expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.897094:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404784.897099:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404784.897114:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79a23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7460 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784404784.897571:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1784404784.897729:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.897742:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.897753:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.897804:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79a23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7460 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.897834:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7460 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.899157:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955ff00) 00010000:00010000:3.0:1784404784.899161:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404784.899166:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6a00, rc 0) 00000100:00100000:3.0:1784404784.899251:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12368:x1871083707912192:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 2239us (6904us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1784404784.899271:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 190 00000100:00100000:2.0:1784404784.904437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.904685:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707912448 00000100:00100000:3.0:1784404784.904696:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707912448 00000100:00100000:3.0:1784404784.904761:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:3.0:1784404784.904771:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12368:x1871083707912448:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784404784.905952:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404784.905999:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79a2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7460 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906019:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955ff00) 00010000:00010000:3.0:1784404784.906030:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404784.906054:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906071:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906083:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906098:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906105:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906112:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906181:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906189:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906195:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906201:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404784.906206:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906214:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906222:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404784.906225:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404784.906228:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906233:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79a38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906241:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906246:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906252:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906262:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404784.906265:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906271:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906279:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd1c289fc (ffff9dd54955fa00) 00010000:00010000:3.0:1784404784.906281:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404784.906283:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.906288:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79a3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd1c289fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.906406:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12368:x1871083707912448:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1634us (1976us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784404784.906416:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 191 00000100:00100000:2.0:1784404784.910765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.910877:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707912576 00000100:00100000:3.0:1784404784.910889:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707912576 00000100:00100000:3.0:1784404784.910953:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:3.0:1784404784.910964:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12368:x1871083707912576:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404784.910984:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404784.911008:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79a46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7467 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.911041:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.911065:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.911076:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.911183:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79a46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.911200:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.911209:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:3.0:1784404784.911211:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784404784.911215:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167e200, rc 0) 00000100:00100000:3.0:1784404784.911281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12368:x1871083707912576:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 319us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.911289:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 192 00000100:00100000:2.0:1784404784.915248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.918081:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707912832 00000100:00100000:3.0:1784404784.918104:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707912832 00000100:00100000:2.0:1784404784.919344:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:2.0:1784404784.919359:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12368:x1871083707912832:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784404784.919462:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.919479:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.919505:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404784.919691:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1784404784.919702:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402803849390ns, next at 403803847025ns, rc = 0 00000004:00010000:2.0:1784404784.919751:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dbdd4bd8 reply state 00000000757d0886 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.919764:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.919774:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:2.0:1784404784.919776:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784404784.919780:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404784.920142:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:12368:x1871083707912832:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 784us (4903us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1784404784.920150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 193 00000100:00100000:0.0:1784404784.922549:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.923343:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707912960 00000100:00100000:3.0:1784404784.923354:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707912960 00000100:00100000:3.0:1784404784.923420:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:3.0:1784404784.923432:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:12368:x1871083707912960:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404784.923460:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404784.923480:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed746e expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.923555:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 69 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.923571:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 69 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.923591:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:3.0:1784404784.923594:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404784.923599:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167fc00, rc 0) 00000100:00100000:3.0:1784404784.923679:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+69:12368:x1871083707912960:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 249us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.923686:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 194 00000100:00100000:0.0:1784404784.926092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.926197:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707913088 00000100:00100000:1.0:1784404784.926208:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707913088 00000100:00100000:1.0:1784404784.926269:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:1.0:1784404784.926280:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+6:2402:x1871083707913088:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784404784.926500:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707913088:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 222us (417us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784404784.926509:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:1.0:1784404784.934219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404784.935689:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707913344 00000100:00100000:0.0:1784404784.935702:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707913344 00000100:00100000:0.0:1784404784.936390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:0.0:1784404784.936403:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+69:12368:x1871083707913344:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784404784.936667:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+70:12368:x1871083707913344:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 266us (2457us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1784404784.936675:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:1.0:1784404784.940189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.940317:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707913600 00000100:00100000:3.0:1784404784.940328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707913600 00000100:00100000:3.0:1784404784.940392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:3.0:1784404784.940403:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+70:12368:x1871083707913600:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784404784.940528:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+70:12368:x1871083707913600:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 126us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.940536:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 195 00000100:00100000:3.0:1784404784.942767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404784.942833:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707913728 00000100:00100000:1.0:1784404784.942869:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707913728 00000100:00100000:1.0:1784404784.942929:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:1.0:1784404784.942940:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+70:12368:x1871083707913728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404784.942958:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404784.942978:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79a62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7475 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.943038:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79a69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.943063:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.943074:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404784.943118:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404784.943135:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.943157:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759000/0x24b3e2e6dcd79a62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7475 expref: 72 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.943173:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79a69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7475 expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404784.943181:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:1.0:1784404784.943183:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784404784.943186:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758e00, rc 0) 00000100:00100000:1.0:1784404784.943232:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+71:12368:x1871083707913728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 294us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404784.943238:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 196 00000100:00100000:1.0:1784404784.945737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.945824:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707913856 00000100:00100000:3.0:1784404784.945835:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707913856 00000100:00100000:3.0:1784404784.945946:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:3.0:1784404784.945957:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707913856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404784.945977:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404784.946012:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed747c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404784.946039:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bdb31, blocks: 0x0 00010000:00010000:3.0:1784404784.946061:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1784404784.946066:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404784.946076:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.946095:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.946109:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167f000, rc 0) 00000100:00100000:3.0:1784404784.946163:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707913856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 208us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.946171:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:1.0:1784404784.948948:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.949102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707914112 00000100:00100000:3.0:1784404784.949112:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707914112 00000100:00100000:3.0:1784404784.949169:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:3.0:1784404784.949181:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+71:12368:x1871083707914112:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784404784.949281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+71:12368:x1871083707914112:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 102us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.949289:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 197 00000100:00100000:1.0:1784404784.962712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.962784:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707914240 00000100:00100000:2.0:1784404784.962794:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707914240 00000100:00100000:2.0:1784404784.962900:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1784404784.962920:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:12368:x1871083707914240:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404784.962940:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404784.962961:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7483 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.962993:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.963017:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404784.963023:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404784.963029:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 9 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.963072:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.963086:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 9 pid: 8434 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404784.963101:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1871083728934144:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404784.963195:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404784.965636:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1871083728934144:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404784.965675:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 9 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404784.965696:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f800, rc 0) 00000100:00100000:2.0:1784404784.965762:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:12368:x1871083707914240:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 2852us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404784.965771:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:1.0:1784404784.968145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404784.968221:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707914368 00000100:00100000:3.0:1784404784.968231:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707914368 00010000:00010000:3.0:1784404784.968271:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 9 pid: 8434 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.968340:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:3.0:1784404784.968349:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707914368:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404784.968367:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404784.968392:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 9 pid: 8434 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.968408:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 9 pid: 8434 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.968431:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd79a70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed747c expref: 9 pid: 8434 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.968449:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404784.968453:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404784.968461:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.968472:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.968510:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404784.968526:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1871083728934272:192.168.202.42@tcp:105: 00000100:00100000:3.0:1784404784.968634:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb78900 going to sleep for 11 seconds 00000100:00100000:3.0:1784404784.983669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404784.983741:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707914496 00000100:00100000:2.0:1784404784.983751:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707914496 00002000:00100000:2.0:1784404784.983802:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9dd443d19f80 x1871083707914496/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:45/0 lens 504/0 e 0 to 0 dl 1784404795 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784404784.983835:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443d19f80 with x1871083707914496 ext(0->8) 00002000:00010000:2.0:1784404784.983841:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443d19f80 00000100:00100000:2.0:1784404784.983901:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:2.0:1784404784.983922:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707914496:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784404784.983956:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1871083728934272:192.168.202.42@tcp:105: 00010000:00010000:0.0:1784404784.983985:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404784.984057:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707914368:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 15708us (15922us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404784.984066:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 86 00000100:00100000:2.0:1784404784.986707:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2403:x1871083707914496:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 2786us (3041us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784404784.986722:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00002000:00100000:2.0:1784404784.986736:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9dd443d19f80 x1871083707914496/t4294967315(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:45/0 lens 504/448 e 0 to 0 dl 1784404795 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784404784.986745:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443d19f80 with x1871083707914496 ext(0->8) 00002000:00010000:2.0:1784404784.986752:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443d19f80 00000100:00100000:3.0:1784404784.991430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404784.991540:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707914624 00000100:00100000:0.0:1784404784.991550:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707914624 00000100:00100000:0.0:1784404784.991618:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 198 00000100:00100000:0.0:1784404784.991631:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+71:12368:x1871083707914624:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784404784.994724:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1784404784.994745:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1784404784.994825:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1784404784.994895:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd54ace4c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1784404784.994901:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd57c8f5300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd54ace4840 00000020:00080000:3.0:1784404784.994904:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd57c8f5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4436e7800 00000020:00080000:3.0:1784404784.995089:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1784404784.995151:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1784404784.995174:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728934400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784404784.995256:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404784.995439:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:12368:x1871083707914624:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 3807us (4015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404784.995449:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 198 00000100:00100000:3.0:1784404784.995638:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728934400 00000100:00100000:3.0:1784404784.995646:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728934400 00000100:00100000:3.0:1784404784.995703:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784404784.995711:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728934400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784404784.995737:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1784404784.995772:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a5bdb2f, atime: 0x6a5bdb2f, ctime: 0x6a5bdb2f, blocks: 0x8 00010000:00010000:3.0:1784404784.995781:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.995805:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1784404784.995819:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404784.995827:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.995845:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.995886:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.995895:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.995923:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784404784.996048:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083728934400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 338us (792us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1784404784.996054:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1784404784.996072:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784404784.996084:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404784.996090:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.996099:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404784.996103:0:10394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.996112:0:10394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.996134:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.996142:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404784.996160:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404784.996162:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404784.996163:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784404784.996194:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd443d18380/2, rc 0, transno 4294967308 00000100:00100000:3.0:1784404784.996200:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728934400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784404784.998234:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404784.998254:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728934528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784404784.998322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404784.998384:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728934528 00000100:00100000:0.0:1784404784.998393:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728934528 00000100:00100000:0.0:1784404784.998460:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784404784.998468:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728934528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1784404784.998622:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784404784.998626:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784404785 00002000:00010000:0.0:1784404784.998628:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784404784.998630:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1784404785 -> 1784404785 00002000:00010000:0.0:1784404784.998632:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1784404784.998677:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728934528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (353us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784404784.998684:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1784404784.998705:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1784404784.998738:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd443cc9180/2, rc 0, transno 4294967316 00000100:00100000:0.0:1784404784.998744:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728934528:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1784404785.001077:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001097:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001106:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001113:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.001118:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001127:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001170:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9dd54955f800) 00010000:00010000:2.0:1784404785.001173:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.001178:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001184:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd7979f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001210:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001216:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001222:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001228:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.001231:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001237:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001244:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404785.001246:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.001248:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001253:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd797a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001282:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001287:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001292:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001297:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.001300:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001305:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001313:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd54955f100) 00010000:00010000:2.0:1784404785.001315:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.001318:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001324:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd797e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001339:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001345:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001350:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001360:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.001363:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001369:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001378:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404785.001380:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.001383:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001389:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd798e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001401:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001405:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001411:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001416:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.001418:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001424:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001442:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404785.001444:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.001448:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001454:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6600/0x24b3e2e6dcd7990b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001465:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001472:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001478:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001483:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.001486:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001492:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001499:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404785.001501:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.001503:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001509:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79951 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001528:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001534:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001541:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001545:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ec00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.001547:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001553:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001561:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:2.0:1784404785.001563:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784404785.001566:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.001573:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79a54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404785.002025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.002092:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707914752 00000100:00100000:0.0:1784404785.002102:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707914752 00000100:00100000:0.0:1784404785.002153:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:0.0:1784404785.002163:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2404:x1871083707914752:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784404785.003720:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1784404785.003735:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1784404785.004300:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707914752:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 2132us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404785.004311:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1784404785.007521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.007613:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707915008 00000100:00100000:0.0:1784404785.007626:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707915008 00000100:00100000:0.0:1784404785.007689:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 199 00000100:00100000:0.0:1784404785.007700:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:12368:x1871083707915008:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784404785.007760:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404785.007792:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758e00/0x24b3e2e6dcd79a69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7475 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.007846:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:0.0:1784404785.008118:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404785.008155:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.008169:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.008179:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784404785.008320:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb796379 reply state 000000008646489f transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.008333:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.008340:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:0.0:1784404785.008342:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784404785.008345:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784404785.008683:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:12368:x1871083707915008:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 982us (1168us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1784404785.008691:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 199 00000100:00100000:2.0:1784404785.011475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.011552:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707915136 00000100:00100000:0.0:1784404785.011562:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707915136 00000100:00100000:0.0:1784404785.011692:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:0.0:1784404785.011703:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707915136:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784404785.012184:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784404785.012203:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1784404785 -> 1784404784 00002000:00010000:0.0:1784404785.012206:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784404783 00002000:00010000:0.0:1784404785.012208:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1784404785 -> 1784404784 00002000:00010000:0.0:1784404785.012210:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1784404785.012320:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707915136:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 617us (850us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1784404785.012328:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:2.0:1784404785.015122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.015205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707915392 00000100:00100000:1.0:1784404785.015217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707915392 00000100:00100000:1.0:1784404785.015309:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:1.0:1784404785.015322:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:12368:x1871083707915392:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784404785.015404:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.015421:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.015432:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.015467:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.015480:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 20 pid: 6521 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404785.015495:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728934656:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404785.015593:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712900 going to sleep for 11 seconds 00000100:00100000:1.0:1784404785.018540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404785.018830:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707915520 00000100:00100000:2.0:1784404785.018895:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707915520 00010000:00010000:2.0:1784404785.018953:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 21 pid: 6521 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404785.018988:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:2.0:1784404785.018997:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570558850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:2404:x1871083707915520:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404785.019012:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404785.019018:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 21 pid: 6521 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.019033:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 21 pid: 6521 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.019056:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:2.0:1784404785.019061:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.019070:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.019078:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.019096:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404785.019156:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570558850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:2404:x1871083707915520:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 159us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404785.019165:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 87 00010000:00010000:3.0:1784404785.020071:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79a4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7467 expref: 20 pid: 6521 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404785.020091:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728934656:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404785.020113:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020191:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020215:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020255:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020262:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020269:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020275:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.020279:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020286:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020300:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:2.0:1784404785.020303:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784404785.020307:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.020312:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759e00/0x24b3e2e6dcd79a8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404785.020413:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:12368:x1871083707915392:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 5092us (5298us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784404785.020422:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 200 00000100:00100000:1.0:1784404785.023500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404785.023587:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707915648 00000100:00100000:3.0:1784404785.023611:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707915648 00000100:00100000:3.0:1784404785.023678:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:3.0:1784404785.023689:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2401:x1871083707915648:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784404785.023736:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.023772:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.023780:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404785.023785:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404785.023790:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.023829:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.023895:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 8 pid: 8488 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404785.023920:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728934784:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404785.023999:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404785.027985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404785.028082:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707915776 00000100:00100000:2.0:1784404785.028093:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707915776 00010000:00010000:2.0:1784404785.028136:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 9 pid: 8488 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404785.028173:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:2.0:1784404785.028183:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2404:x1871083707915776:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404785.028201:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404785.028223:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 9 pid: 8488 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.028238:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 9 pid: 8488 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.028264:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784404785.028268:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784404785.028274:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.028285:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.028307:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404785.028376:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2404:x1871083707915776:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 193us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404785.028385:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 88 00010000:00010000:1.0:1784404785.028503:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001413e440/0x24b3e2e6dcd79a77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7483 expref: 8 pid: 8488 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404785.028521:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728934784:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404785.028543:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028573:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028581:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028614:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028623:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028632:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028639:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404785.028643:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028653:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028666:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.028685:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd79a93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404785.028737:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2401:x1871083707915648:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 5050us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404785.028745:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:1.0:1784404785.033275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404785.033359:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707916032 00000100:00100000:3.0:1784404785.033369:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707916032 00000100:00100000:3.0:1784404785.033435:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 201 00000100:00100000:3.0:1784404785.033447:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:12368:x1871083707916032:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784404785.033536:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.033556:0:9527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.033586:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.033628:0:9527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.033642:0:9527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 19 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404785.033657:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728934912:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404785.033908:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57cb780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404785.037135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404785.037206:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707916160 00000100:00100000:2.0:1784404785.037231:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707916160 00010000:00010000:2.0:1784404785.037262:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 20 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404785.037298:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 89 00000100:00100000:2.0:1784404785.037305:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:2403:x1871083707916160:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404785.037316:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404785.037321:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 20 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.037330:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 20 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.037349:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404785.037353:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.037360:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.037365:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.037377:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404785.037432:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:2403:x1871083707916160:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404785.037440:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 89 00010000:00010000:0.0:1784404785.038321:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd798e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed740c expref: 19 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.038335:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728934912:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404785.038353:0:9527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.038360:0:9527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.038363:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.038525:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.038533:0:9527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 19 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.038538:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.038568:0:9527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 19 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.038594:0:9527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 19 pid: 13543 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.038620:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728935040:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404785.038732:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56cee9300 going to sleep for 11 seconds 00000100:00100000:3.0:1784404785.041300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404785.041358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707916288 00000100:00100000:2.0:1784404785.041367:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707916288 00010000:00010000:2.0:1784404785.041431:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 20 pid: 13543 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404785.041480:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 90 00000100:00100000:2.0:1784404785.041491:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:2404:x1871083707916288:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404785.041505:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404785.041513:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 20 pid: 13543 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.041525:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 20 pid: 13543 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.041802:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:2.0:1784404785.041809:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.041821:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.041828:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.041848:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404785.041958:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:2404:x1871083707916288:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 467us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404785.041966:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 90 00010000:00010000:0.0:1784404785.042382:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79a5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed746e expref: 19 pid: 13543 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.042404:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728935040:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404785.042431:0:9527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.042667:0:9527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.042674:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784404785.042778:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1784404785.043120:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1784404785.043154:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1784404785.043236:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728935168:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784404785.043289:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404785.043320:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580fcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784404785.043340:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728935168 00000100:00100000:0.0:1784404785.043348:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728935168 00000100:00100000:0.0:1784404785.043441:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784404785.043450:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9527:x1871083728935168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784404785.043539:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9527:x1871083728935168:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404785.043547:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784404785.043602:0:9527:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1784404785.043608:0:9527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd443cc9180, transno 4294967316 00000100:00100000:1.0:1784404785.043664:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728935168:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1784404785.043760:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1784404785.043791:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728935296:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784404785.043808:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404785.043841:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404785.043962:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728935296 00000100:00100000:3.0:1784404785.043968:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728935296 00000100:00100000:3.0:1784404785.044000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784404785.044009:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9527:x1871083728935296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784404785.044111:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9527:x1871083728935296:12345-0@lo:1000:mdt00_003.0 Request processed in 103us (300us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784404785.044118:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784404785.044134:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9527:1871083728935296:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1784404785.044172:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044187:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044194:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044199:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ae00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.044204:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044211:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044226:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:2.0:1784404785.044229:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784404785.044233:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044237:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79aa1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044255:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044259:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044263:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044266:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.044272:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044276:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044281:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:2.0:1784404785.044283:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784404785.044285:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044289:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd799d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044307:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044317:0:9527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044322:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044341:0:9527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.044352:0:9527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 22 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404785.044359:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443c8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728935424:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404785.044417:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404785.046598:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.046642:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443c8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9527:1871083728935424:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404785.046663:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707916416 00010000:00010000:1.0:1784404785.046666:0:9527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.046670:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707916416 00010000:00010000:0.0:1784404785.046701:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 23 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.046731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:0.0:1784404785.046741:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:2403:x1871083707916416:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404785.046767:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404785.046772:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 23 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.046780:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 23 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.046797:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd799f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7452 expref: 23 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.046808:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:0.0:1784404785.046819:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.046827:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.046832:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.046881:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404785.046889:0:9527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046896:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046907:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046925:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046931:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046937:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404785.046941:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046948:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046957:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:1.0:1784404785.046960:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404785.046963:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046970:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79aa8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046988:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046993:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.046998:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.047003:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167f000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404785.047005:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.047011:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.047019:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443310b00) 00010000:00010000:1.0:1784404785.047022:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404785.047025:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.047030:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79a9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.047301:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2403:x1871083707916416:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 561us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404785.047309:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:1.0:1784404785.047350:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:12368:x1871083707916032:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 13905us (14084us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1784404785.047359:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 201 00000020:00080000:1.0:1784404785.047362:0:9527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784404785.047457:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404785.047461:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404785.047985:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1784404785.047994:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784404785.049975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404785.050130:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707916672 00000100:00100000:3.0:1784404785.050143:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707916672 00000100:00100000:3.0:1784404785.050231:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:3.0:1784404785.050243:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd548288c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:12368:x1871083707916672:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784404785.050494:0:6522:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784404785.050534:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1784404785.050565:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.050581:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.050593:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.050613:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.050620:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.050626:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.050651:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784404785.050735:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd548288c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:12368:x1871083707916672:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 495us (768us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1784404785.050744:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000020:00080000:3.0:1784404785.050748:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784404785.050827:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404785.050834:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.050867:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404785.050873:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.050881:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.050895:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:2.0:1784404785.050898:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784404785.050903:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.050909:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79aaf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.050933:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404785.050935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404785.050937:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404785.411318:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784404785.438028:0:14654:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404785.438037:0:14654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404785.438063:0:14654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784404785.438069:0:14654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784404785.609559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.609629:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707916928 00000100:00100000:0.0:1784404785.609641:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707916928 00000100:00100000:0.0:1784404785.609765:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00100000:0.0:1784404785.609773:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:12378:x1871083707916928:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404785.609819:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404785.609914:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed748a expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.610053:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd79abd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.610070:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd79abd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.610083:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd79abd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404785.610094:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1784404785.610421:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed748a expref: 26 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.610478:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd79abd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed748a expref: 25 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.610485:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404785.610488:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404785.610491:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:0.0:1784404785.610587:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:12378:x1871083707916928:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 814us (1034us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1784404785.610595:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 202 00000100:00100000:1.0:1784404785.615920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404785.616008:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707917056 00000100:00100000:3.0:1784404785.616022:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707917056 00000100:00100000:3.0:1784404785.616096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 203 00000100:00100000:3.0:1784404785.616108:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:12378:x1871083707917056:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:3.0:1784404785.616208:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616239:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616253:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616269:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616277:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616284:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616365:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616380:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404785.616432:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616446:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616453:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616469:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616475:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167f000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404785.616479:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616487:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616500:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404785.616503:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404785.616508:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616514:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79acb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616526:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616532:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616538:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616543:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404785.616545:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616559:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616566:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd544e47000) 00010000:00010000:3.0:1784404785.616569:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404785.616572:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616577:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79ad2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616591:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616597:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616602:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616607:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404785.616610:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616615:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616621:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:3.0:1784404785.616624:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404785.616626:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.616639:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79ad9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404785.616710:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:12378:x1871083707917056:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 604us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404785.616718:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 203 00000100:00100000:1.0:1784404785.676696:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404785.676801:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707917312 00000100:00100000:2.0:1784404785.676813:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707917312 00000100:00100000:2.0:1784404785.676918:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 204 00000100:00100000:2.0:1784404785.676931:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:12381:x1871083707917312:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404785.676958:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404785.676983:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79ae0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7491 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677072:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677083:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677093:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677105:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677109:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677113:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677217:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677222:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677226:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404785.677234:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784404785.677298:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677304:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677313:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677318:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.677321:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677325:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677334:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404785.677337:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.677340:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677344:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79ae7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677356:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677359:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677363:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677366:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404785.677368:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677377:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677382:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:2.0:1784404785.677384:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404785.677385:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677388:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79aee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677416:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79ae0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677424:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404785.677428:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:2.0:1784404785.677429:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404785.677431:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f000, rc 0) 00000100:00100000:2.0:1784404785.677503:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12381:x1871083707917312:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 576us (823us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1784404785.677509:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 204 00000100:00100000:3.0:1784404785.682077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.682307:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707917440 00000100:00100000:0.0:1784404785.682318:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707917440 00000100:00100000:0.0:1784404785.682395:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 205 00000100:00100000:0.0:1784404785.682421:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12381:x1871083707917440:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:0.0:1784404785.682515:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682531:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682542:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682581:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682589:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682595:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682600:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404785.682603:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682609:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682619:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:0.0:1784404785.682621:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784404785.682624:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.682628:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.682755:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12381:x1871083707917440:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 336us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404785.682760:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 205 00000100:00100000:0.0:1784404785.688033:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404785.688134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707917696 00000100:00100000:2.0:1784404785.688146:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707917696 00000100:00100000:2.0:1784404785.688219:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:2.0:1784404785.688230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12381:x1871083707917696:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404785.688456:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+28:12381:x1871083707917696:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 228us (434us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1784404785.688464:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:1.0:1784404785.719590:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.719937:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707917952 00000100:00100000:0.0:1784404785.719948:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707917952 00000100:00100000:0.0:1784404785.720021:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 206 00000100:00100000:0.0:1784404785.720033:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+28:11913:x1871083707917952:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404785.720064:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404785.720088:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7498 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.720214:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.720231:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 29 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.720240:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.720276:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 29 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.720291:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 29 pid: 9527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404785.720325:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728935552:192.168.202.42@tcp:104: 00000100:00100000:0.0:1784404785.720435:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404785.728970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404785.729125:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707918080 00000100:00100000:3.0:1784404785.729132:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707918080 00000100:00100000:0.0:1784404785.729143:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728935552:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784404785.729168:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.729169:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 30 pid: 9527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404785.729218:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:3.0:1784404785.729228:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:2403:x1871083707918080:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404785.729244:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404785.729251:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 30 pid: 9527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.729262:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 30 pid: 9527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.729285:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79af5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7491 expref: 30 pid: 9527 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.729301:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:3.0:1784404785.729305:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.729340:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.729348:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.729372:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784404785.729398:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.729405:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404785.729422:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000100:00100000:3.0:1784404785.729435:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:2403:x1871083707918080:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 201us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404785.729443:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 92 00010000:00010000:0.0:1784404785.729949:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79b0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.729968:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.729975:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:0.0:1784404785.729978:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404785.729980:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a400, rc 0) 00000100:00100000:0.0:1784404785.730066:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:11913:x1871083707917952:12345-192.168.202.42@tcp:101:bash.0 Request processed in 10035us (10486us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1784404785.730074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 206 00000100:00100000:2.0:1784404785.732616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.732672:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707918208 00000100:00100000:1.0:1784404785.732681:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707918208 00000100:00100000:1.0:1784404785.732730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 207 00000100:00100000:1.0:1784404785.732738:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:11913:x1871083707918208:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404785.732758:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404785.732775:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed749f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.732799:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd79b26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.732810:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd79b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.732819:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd79b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.733049:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed749f expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.733067:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd79b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed749f expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.733082:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:1.0:1784404785.733085:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404785.733089:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759c00, rc 0) 00000100:00100000:1.0:1784404785.733143:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:11913:x1871083707918208:12345-192.168.202.42@tcp:101:bash.0 Request processed in 405us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404785.733150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 207 00000100:00100000:1.0:1784404785.734783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.735568:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707918464 00000100:00100000:0.0:1784404785.735594:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707918464 00000100:00100000:0.0:1784404785.735733:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 208 00000100:00100000:0.0:1784404785.735744:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:11913:x1871083707918464:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:0.0:1784404785.736051:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.736065:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.736073:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404785.736105:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1784404785.736119:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001aa41eaf reply state 00000000d35d5dff transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.736128:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.736133:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:0.0:1784404785.736135:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784404785.736137:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784404785.736162:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1784404785.736358:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:11913:x1871083707918464:12345-192.168.202.42@tcp:36:bash.0 Request processed in 614us (1578us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1784404785.736365:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 208 00000020:00080000:0.0:1784404785.736371:0:13543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1784404785.738076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.738114:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707918592 00000100:00100000:1.0:1784404785.738124:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707918592 00000100:00100000:1.0:1784404785.738220:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 209 00000100:00100000:1.0:1784404785.738229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+34:11913:x1871083707918592:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404785.738245:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404785.738260:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79b34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.738300:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74a6 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.738309:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74a6 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.738322:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:1.0:1784404785.738324:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404785.738327:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758a00, rc 0) 00000100:00100000:1.0:1784404785.738378:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:11913:x1871083707918592:12345-192.168.202.42@tcp:101:bash.0 Request processed in 150us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404785.738397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 209 00000100:00100000:2.0:1784404785.740312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.740432:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707918720 00000100:00100000:0.0:1784404785.740442:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707918720 00000100:00100000:0.0:1784404785.740501:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:0.0:1784404785.740510:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:11913:x1871083707918720:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404785.740540:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404785.740558:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74ad expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784404785.740582:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a5bdb30, atime: 0x6a5bdb2f, ctime: 0x6a5bdb30, blocks: 0x8 00010000:00010000:0.0:1784404785.740616:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1784404785.740621:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404785.740630:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.740647:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.740669:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b400, rc 0) 00000100:00100000:0.0:1784404785.740944:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:11913:x1871083707918720:12345-192.168.202.42@tcp:101:bash.0 Request processed in 434us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404785.740951:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:0.0:1784404785.742967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404785.743018:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707918848 00000100:00100000:3.0:1784404785.743027:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707918848 00002000:00010000:3.0:1784404785.743069:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1784404785.743074:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443cc8e00 with x1871083707918848 ext(0->18446744073709551615) 00002000:00010000:3.0:1784404785.743083:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443cc8e00. 00000100:00100000:3.0:1784404785.743111:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:3.0:1784404785.743122:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707918848:12345-192.168.202.42@tcp:10:bash.0 00002000:00010000:3.0:1784404785.743478:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784404785.743481:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1784404784 -> 1784404786 00002000:00010000:3.0:1784404785.743482:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1784404783 -> 1784404783 00002000:00010000:3.0:1784404785.743484:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1784404784 -> 1784404786 00002000:00010000:3.0:1784404785.743486:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1784404785.743535:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2404:x1871083707918848:12345-192.168.202.42@tcp:10:bash.0 Request processed in 414us (574us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1784404785.743542:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00002000:00010000:3.0:1784404785.743545:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1784404785.743559:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443cc8e00 with x1871083707918848 ext(0->18446744073709551615) 00002000:00010000:3.0:1784404785.743565:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443cc8e00. 00000100:00100000:2.0:1784404785.826527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.826632:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707918976 00000100:00100000:1.0:1784404785.826642:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707918976 00000100:00100000:1.0:1784404785.826752:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 210 00000100:00100000:1.0:1784404785.826763:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:12395:x1871083707918976:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:1.0:1784404785.826893:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.826918:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.826932:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.826948:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.826955:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.826960:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827038:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827047:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827054:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784404785.827127:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827139:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827146:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827153:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827159:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404785.827163:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827170:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827182:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:1.0:1784404785.827184:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404785.827189:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827195:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827222:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827228:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827240:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827245:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404785.827247:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827254:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827261:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd573869700) 00010000:00010000:1.0:1784404785.827264:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404785.827267:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827272:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827286:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827292:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827298:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827303:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404785.827305:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827320:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827723:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:1.0:1784404785.827728:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404785.827732:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.827739:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404785.827838:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:12395:x1871083707918976:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 1074us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404785.827847:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 210 00000100:00100000:2.0:1784404785.873133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.873262:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707919232 00000100:00100000:0.0:1784404785.873272:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707919232 00000100:00100000:0.0:1784404785.873335:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 211 00000100:00100000:0.0:1784404785.873346:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+35:12398:x1871083707919232:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784404785.873369:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404785.873390:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79b57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74b4 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873492:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873507:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873519:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873537:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873544:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873551:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873682:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79b6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873691:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873698:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404785.873709:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784404785.873797:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873814:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873821:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873827:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404785.873832:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873882:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873896:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404785.873899:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404785.873913:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873920:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd79b5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873933:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873937:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873942:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873947:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404785.873956:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873963:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873970:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443310a00) 00010000:00010000:0.0:1784404785.873973:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404785.873976:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.873981:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd79b65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.874023:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ae00/0x24b3e2e6dcd79b57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74b4 expref: 38 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.874038:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79b6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74b4 expref: 37 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404785.874045:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:0.0:1784404785.874046:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784404785.874049:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a800, rc 0) 00000100:00100000:0.0:1784404785.874121:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12398:x1871083707919232:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 777us (999us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1784404785.874129:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 211 00000100:00100000:0.0:1784404785.878575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.878777:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707919360 00000100:00100000:1.0:1784404785.878787:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707919360 00000100:00100000:1.0:1784404785.878934:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 212 00000100:00100000:1.0:1784404785.878946:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12398:x1871083707919360:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:1.0:1784404785.879022:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.879041:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.879051:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.879087:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.879123:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 37 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404785.879139:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728935680:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404785.879245:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404785.885945:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404785.886045:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707919616 00000100:00100000:0.0:1784404785.886057:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707919616 00000100:00100000:0.0:1784404785.886128:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1784404785.886158:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44373a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:6170:x1871083707919616:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784404785.886775:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44373a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:6170:x1871083707919616:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 617us (842us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1784404785.886784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:1.0:1784404785.887548:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728935680:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404785.887575:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404785.890844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.891417:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707919744 00000100:00100000:1.0:1784404785.891428:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707919744 00010000:00010000:1.0:1784404785.891475:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 39 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404785.891517:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 93 00000100:00100000:1.0:1784404785.891527:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:2404:x1871083707919744:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404785.891542:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404785.891549:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 39 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.891562:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 39 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.891588:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd79b11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7498 expref: 39 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.891626:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:1.0:1784404785.891631:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.891641:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.891660:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.891700:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404785.891757:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:2404:x1871083707919744:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 231us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404785.891765:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 93 00010000:00010000:3.0:1784404785.893259:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893272:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893320:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893331:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893335:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893340:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404785.893343:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893347:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893361:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:3.0:1784404785.893363:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404785.893366:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404785.893371:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd79b7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404785.893482:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12398:x1871083707919360:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 14535us (14916us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404785.893490:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 212 00000100:00100000:3.0:1784404785.899943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404785.900046:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707920000 00000100:00100000:2.0:1784404785.900056:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707920000 00000100:00100000:2.0:1784404785.900105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:2.0:1784404785.900115:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+37:12398:x1871083707920000:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404785.900530:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:12398:x1871083707920000:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 415us (597us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1784404785.900539:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:2.0:1784404785.975246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404785.975353:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707920256 00000100:00100000:1.0:1784404785.975364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707920256 00000100:00100000:1.0:1784404785.975427:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 213 00000100:00100000:1.0:1784404785.975438:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+38:12409:x1871083707920256:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:1.0:1784404785.975464:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404785.975485:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74bb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975564:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975581:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975643:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975725:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975732:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975736:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975973:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79b96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975983:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.975991:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404785.976003:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1784404785.976082:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976090:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976096:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976102:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404785.976106:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976123:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976135:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:1.0:1784404785.976138:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404785.976143:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976149:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79b88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976164:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976170:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976175:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976179:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404785.976181:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976184:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976189:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd573869700) 00010000:00010000:1.0:1784404785.976190:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404785.976192:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976202:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79b8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976242:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79b81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74bb expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976257:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79b96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74bb expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404785.976265:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:1.0:1784404785.976267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404785.976269:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759200, rc 0) 00000100:00100000:1.0:1784404785.976384:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:12409:x1871083707920256:12345-192.168.202.42@tcp:101:cat.0 Request processed in 946us (1148us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1784404785.976391:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 213 00000100:00100000:2.0:1784404785.980404:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404785.980490:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707920512 00000100:00100000:3.0:1784404785.980500:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707920512 00000100:00100000:3.0:1784404785.980560:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:3.0:1784404785.980570:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+40:12409:x1871083707920512:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:3.0:1784404785.981211:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+41:12409:x1871083707920512:12345-192.168.202.42@tcp:35:cat.0 Request processed in 640us (813us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1784404785.981220:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:3.0:1784404786.000406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404786.000922:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707920768 00000100:00100000:2.0:1784404786.000941:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707920768 00000100:00100000:2.0:1784404786.001028:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 214 00000100:00100000:2.0:1784404786.001040:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+41:12410:x1871083707920768:12345-192.168.202.42@tcp:36:rm.0 00010000:00010000:2.0:1784404786.001103:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1784404786.001130:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758a00/0x24b3e2e6dcd79b34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74a6 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001175:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759200/0x24b3e2e6dcd79b96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74bb expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001185:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79b6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74b4 expref: 39 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001195:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd79b26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed749f expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001204:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:2.0:1784404786.001208:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404786.001229:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001240:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001249:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001261:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001267:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001274:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001358:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001367:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001374:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404786.001588:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1784404786.001613:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403885761056ns, next at 404885758596ns, rc = 0 00010000:00010000:2.0:1784404786.001657:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001665:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001672:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001679:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001686:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001692:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001713:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404786.001729:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001742:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001748:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001754:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404786.001758:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001765:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001774:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:2.0:1784404786.001777:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784404786.001781:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001787:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79bb2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001802:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001809:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001815:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001821:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404786.001830:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001836:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001844:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404786.001846:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404786.001888:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001895:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79ba4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404786.001914:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021519c9f reply state 0000000075d8cf44 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001926:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.001933:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:2.0:1784404786.001935:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404786.001937:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404786.002017:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:12410:x1871083707920768:12345-192.168.202.42@tcp:36:rm.0 Request processed in 979us (1623us total) trans 4294967483 rc 0/0 00010000:00010000:3.0:1784404786.002019:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404786.002030:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404786.002030:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 214 00010000:00010000:3.0:1784404786.002041:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404786.002045:0:10394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.002053:0:10394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.002064:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:3.0:1784404786.002067:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784404786.002070:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.002088:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd79bb9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.002101:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404786.002103:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404786.002105:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784404786.002791:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404786.045188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.045294:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707921024 00000100:00100000:3.0:1784404786.045305:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707921024 00000100:00100000:3.0:1784404786.045378:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 215 00000100:00100000:3.0:1784404786.045391:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+39:12416:x1871083707921024:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404786.045420:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.045444:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79bc0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.045571:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.045589:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.045614:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.045627:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.045635:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.045641:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784404786.046297:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1784404786.046466:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046477:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046486:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046522:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046530:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046536:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046543:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.046548:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046556:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046567:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404786.046570:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404786.046574:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046605:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bc7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404786.046621:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036d2d6b1 reply state 00000000a650bb80 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046632:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046638:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:3.0:1784404786.046640:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404786.046644:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784404786.046678:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167fc00/0x24b3e2e6dcd79bc0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046692:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.046700:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:3.0:1784404786.046703:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404786.046705:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167f000, rc 0) 00000100:00100000:3.0:1784404786.047165:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+42:12416:x1871083707921024:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1775us (1986us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1784404786.047174:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 215 00000100:00100000:2.0:1784404786.051293:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404786.051383:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707921152 00000100:00100000:0.0:1784404786.051393:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707921152 00000100:00100000:0.0:1784404786.051465:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:0.0:1784404786.051477:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57cb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707921152:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784404786.051494:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404786.051514:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74c9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784404786.051538:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404786.051569:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1784404786.051574:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404786.051584:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.051602:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.051616:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ae00, rc 0) 00000100:00100000:0.0:1784404786.051679:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57cb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2402:x1871083707921152:12345-192.168.202.42@tcp:101:bash.0 Request processed in 205us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404786.051687:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00080000:3.0:1784404786.052068:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404786.055921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.056277:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707921280 00000100:00100000:3.0:1784404786.056290:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707921280 00000100:00100000:3.0:1784404786.056358:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:3.0:1784404786.056370:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:12416:x1871083707921280:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404786.056408:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.056427:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74d0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.056463:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.056473:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404786.056478:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404786.056483:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.056521:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.056533:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 9 pid: 8434 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.056546:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1871083728935808:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404786.056668:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd558d61000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404786.060398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.060531:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1871083728935808:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404786.060575:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.060608:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167fc00, rc 0) 00000100:00100000:3.0:1784404786.060680:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:12416:x1871083707921280:12345-192.168.202.42@tcp:101:bash.0 Request processed in 4312us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.060689:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:1.0:1784404786.061185:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707921408 00000100:00100000:1.0:1784404786.061195:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707921408 00010000:00010000:1.0:1784404786.061237:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 9 pid: 8434 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404786.061268:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:1.0:1784404786.061278:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2404:x1871083707921408:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404786.061292:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404786.061317:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 9 pid: 8434 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.061343:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 9 pid: 8434 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.061365:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c6d039/0x24b3e2e6dcd79be3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c9 expref: 9 pid: 8434 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.061381:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404786.061386:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404786.061396:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.061407:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.061445:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404786.061459:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1871083728935936:192.168.202.42@tcp:105: 00000100:00100000:1.0:1784404786.061544:0:6504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404786.069314:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1871083728935936:192.168.202.42@tcp:105: 00010000:00010000:1.0:1784404786.069345:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404786.069731:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707921408:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 8452us (9342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.069745:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 94 00000100:00100000:2.0:1784404786.077267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.077388:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707921664 00000100:00100000:3.0:1784404786.077399:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707921664 00000100:00100000:3.0:1784404786.077464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:3.0:1784404786.077475:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+42:12416:x1871083707921664:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:3.0:1784404786.077797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:12416:x1871083707921664:12345-192.168.202.42@tcp:35:bash.0 Request processed in 322us (538us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1784404786.077805:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:2.0:1784404786.218140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.218332:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707921792 00000100:00100000:1.0:1784404786.218343:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707921792 00000100:00100000:1.0:1784404786.218454:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 216 00000100:00100000:1.0:1784404786.218466:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+43:12432:x1871083707921792:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404786.218493:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404786.218514:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74d7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.218623:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79bf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.218640:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.218667:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404786.218717:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1784404786.218721:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404786.218752:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.218779:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d7 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.218801:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d7 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.218810:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:1.0:1784404786.218813:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784404786.218825:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758000, rc 0) 00000100:00100000:1.0:1784404786.218941:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:12432:x1871083707921792:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 477us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.218948:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 216 00000100:00100000:2.0:1784404786.225980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.226045:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707922048 00000100:00100000:3.0:1784404786.226054:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707922048 00000100:00100000:3.0:1784404786.226116:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 217 00000100:00100000:3.0:1784404786.226126:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57ca1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+44:12432:x1871083707922048:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404786.226147:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.226166:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74de expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.226285:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e400/0x24b3e2e6dcd79c06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.226299:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e400/0x24b3e2e6dcd79c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.226311:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e400/0x24b3e2e6dcd79c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404786.226322:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784404786.226442:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79bff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74de expref: 47 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.226462:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e400/0x24b3e2e6dcd79c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74de expref: 46 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.226470:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:3.0:1784404786.226473:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404786.226476:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54167e400, rc 0) 00000100:00100000:3.0:1784404786.226602:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57ca1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+46:12432:x1871083707922048:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 467us (622us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1784404786.226610:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 217 00000100:00100000:0.0:1784404786.230417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.230515:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707922176 00000100:00100000:1.0:1784404786.230525:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707922176 00000100:00100000:1.0:1784404786.230604:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1784404786.230615:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+46:2402:x1871083707922176:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404786.230632:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404786.230657:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e400/0x24b3e2e6dcd79c06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74de expref: 46 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.230679:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:1.0:1784404786.230684:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404786.230746:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+45:2402:x1871083707922176:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 132us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.230754:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:2.0:1784404786.233143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.233392:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707922432 00000100:00100000:3.0:1784404786.233402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707922432 00000100:00100000:3.0:1784404786.233461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 218 00000100:00100000:3.0:1784404786.233471:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+45:12432:x1871083707922432:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404786.233502:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.233521:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79c14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74e5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.233637:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.233650:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.233662:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404786.233694:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784404786.233798:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e000/0x24b3e2e6dcd79c14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74e5 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.233818:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74e5 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.233827:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:3.0:1784404786.233829:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784404786.233834:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6400, rc 0) 00000100:00100000:3.0:1784404786.234126:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+47:12432:x1871083707922432:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 656us (991us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1784404786.234133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 218 00000100:00100000:0.0:1784404786.240124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.240251:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707922560 00000100:00100000:3.0:1784404786.240260:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707922560 00000100:00100000:3.0:1784404786.240340:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:3.0:1784404786.240350:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707922560:12345-192.168.202.42@tcp:1:lfs.0 00010000:00010000:3.0:1784404786.240390:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.240410:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.240419:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1784404786.240423:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404786.240428:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.240473:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.240486:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 8 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.240501:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1871083728936064:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404786.240598:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a559a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404786.242823:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1871083728936064:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404786.242879:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404786.243954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.244359:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707922688 00000100:00100000:3.0:1784404786.244368:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707922688 00002000:00100000:3.0:1784404786.244419:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9dd443cca300 x1871083707922688/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:47/0 lens 504/0 e 0 to 0 dl 1784404797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784404786.244429:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443cca300 with x1871083707922688 ext(0->8) 00010000:00010000:3.0:1784404786.244437:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 9 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.244458:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 9 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404786.244465:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd443cca300 00000100:00100000:3.0:1784404786.244511:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1784404786.244521:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707922688:12345-192.168.202.42@tcp:4:lfs.0 00000100:00100000:3.0:1784404786.245522:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:2403:x1871083707922688:12345-192.168.202.42@tcp:4:lfs.0 Request processed in 996us (1566us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784404786.245533:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00002000:00100000:3.0:1784404786.245542:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9dd443cca300 x1871083707922688/t4294967309(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:47/0 lens 504/448 e 0 to 0 dl 1784404797 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784404786.245551:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443cca300 with x1871083707922688 ext(0->8) 00010000:00010000:3.0:1784404786.245559:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 11 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.245572:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 11 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404786.245579:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9dd443cca300 00000100:00100000:0.0:1784404786.248948:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.249075:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707922816 00000100:00100000:3.0:1784404786.249085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707922816 00010000:00010000:3.0:1784404786.249126:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 11 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.249168:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 95 00000100:00100000:3.0:1784404786.249189:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:2403:x1871083707922816:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404786.249205:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784404786.249224:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784404786.249227:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784404786 00002000:00010000:3.0:1784404786.249242:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784404786 00002000:00010000:3.0:1784404786.249245:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1784404786 00002000:00010000:3.0:1784404786.249247:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784404786.249255:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 11 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.249269:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 11 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.249295:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd79bea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d0 expref: 11 pid: 8433 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.249312:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404786.249317:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784404786.249323:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.249334:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.249370:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404786.249426:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2403:x1871083707922816:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 239us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.249434:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 95 00010000:00010000:0.0:1784404786.249550:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249560:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249579:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249588:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249605:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249612:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404786.249617:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249625:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249637:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404786.249652:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a798e8e9/0x24b3e2e6dcd79c29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404786.249696:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707922560:12345-192.168.202.42@tcp:1:lfs.0 Request processed in 9348us (9581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404786.249704:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:2.0:1784404786.253271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.253396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707923072 00000100:00100000:3.0:1784404786.253406:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707923072 00000100:00100000:3.0:1784404786.253465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:3.0:1784404786.253476:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+47:12432:x1871083707923072:12345-192.168.202.42@tcp:35:lfs.0 00000004:00010000:3.0:1784404786.253554:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74e5 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784404786.253750:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1784404786.253784:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1784404786.254132:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1784404786.254170:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.254318:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.254329:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.254371:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.254386:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 51 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.254402:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728936192:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404786.254520:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a559a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784404786.257610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.257682:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707923200 00000100:00100000:1.0:1784404786.257690:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707923200 00010000:00010000:1.0:1784404786.257726:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 52 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404786.257762:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:1.0:1784404786.257771:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:2404:x1871083707923200:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404786.257785:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404786.257791:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 52 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.257828:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 52 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.257885:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:1.0:1784404786.257890:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.257900:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.257915:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.257933:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404786.257976:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+52:2404:x1871083707923200:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 206us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.257983:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 96 00010000:00010000:3.0:1784404786.258074:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167f000/0x24b3e2e6dcd79bd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74c2 expref: 51 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.258091:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1871083728936192:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404786.258110:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.258124:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.258130:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784404786.258236:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1784404786.258329:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1784404786.258409:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728936320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784404786.258447:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404786.258479:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548556600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404786.258580:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728936320 00000100:00100000:1.0:1784404786.258584:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728936320 00000100:00100000:1.0:1784404786.258626:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784404786.258633:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1871083728936320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784404786.258693:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1871083728936320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.258699:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1784404786.259160:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404786.259193:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728936320:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784404786.259289:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1784404786.259329:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728936448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784404786.259359:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404786.259372:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a5593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404786.259498:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728936448 00000100:00100000:0.0:1784404786.259502:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728936448 00000100:00100000:0.0:1784404786.259532:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784404786.259540:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6522:x1871083728936448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784404786.259642:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6522:x1871083728936448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (282us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784404786.259649:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784404786.260451:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1871083728936448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784404786.260495:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1784404786.260528:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.260537:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.260545:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.260565:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.260570:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.260578:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.260602:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:3.0:1784404786.260605:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784404786.260610:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.260616:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c30 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784404786.260703:0:6522:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784404786.260757:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1784404786.260767:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404144914367ns, next at 405144912544ns, rc = 0 00000001:00080000:3.0:1784404786.260772:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1784404786.260790:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd544e47600) 00010000:00010000:3.0:1784404786.260792:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784404786.260799:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c1b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74e5 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.261075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:12432:x1871083707923072:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 7600us (7813us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1784404786.261084:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000020:00080000:3.0:1784404786.261088:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784404786.263561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.263657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707923328 00000100:00100000:1.0:1784404786.263667:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707923328 00000100:00100000:1.0:1784404786.263738:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 219 00000100:00100000:1.0:1784404786.263749:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+54:12432:x1871083707923328:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404786.263789:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404786.263825:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79c37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74ec expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.263933:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79c37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ec expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.263950:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79c37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ec expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.263969:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404786.263973:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404786.263976:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759a00, rc 0) 00000100:00100000:1.0:1784404786.264029:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:12432:x1871083707923328:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 281us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.264036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 219 00000100:00100000:0.0:1784404786.267209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404786.267393:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707923584 00000100:00100000:2.0:1784404786.267403:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707923584 00000100:00100000:2.0:1784404786.267457:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:2.0:1784404786.267467:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+55:12432:x1871083707923584:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404786.267707:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:12432:x1871083707923584:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 240us (504us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1784404786.267714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:2.0:1784404786.354669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.355361:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707923712 00000100:00100000:3.0:1784404786.355373:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707923712 00000100:00100000:3.0:1784404786.355440:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 220 00000100:00100000:3.0:1784404786.355451:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:12442:x1871083707923712:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:3.0:1784404786.355540:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355558:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355571:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355583:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355602:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355609:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355688:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355986:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.355997:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404786.356049:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356080:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356087:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356094:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356100:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.356104:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356111:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356124:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404786.356127:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404786.356132:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356139:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356152:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356159:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356164:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356175:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.356179:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356185:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356193:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:3.0:1784404786.356196:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404786.356199:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356203:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356213:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356219:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356225:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356229:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.356232:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356238:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356254:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404786.356257:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404786.356260:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.356266:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.356340:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:12442:x1871083707923712:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 889us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.356349:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 220 00000100:00100000:0.0:1784404786.392508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.392717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707923968 00000100:00100000:3.0:1784404786.392729:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707923968 00000100:00100000:3.0:1784404786.392800:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 221 00000100:00100000:3.0:1784404786.392811:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+56:12445:x1871083707923968:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404786.392833:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.392894:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74f3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.392988:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393005:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393018:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393031:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393054:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393062:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393181:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393190:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393197:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404786.393208:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784404786.393292:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393299:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393305:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393312:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.393316:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393324:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393348:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404786.393351:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404786.393357:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393364:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79c5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393378:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393383:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393388:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393392:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.393395:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393399:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393405:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:3.0:1784404786.393407:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404786.393410:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79c61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393472:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393488:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.393494:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404786.393496:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404786.393499:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7400, rc 0) 00000100:00100000:3.0:1784404786.393568:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:12445:x1871083707923968:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 759us (1070us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1784404786.393576:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 221 00000100:00100000:0.0:1784404786.400275:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.400355:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707924096 00000100:00100000:3.0:1784404786.400365:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707924096 00000100:00100000:3.0:1784404786.400436:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 222 00000100:00100000:3.0:1784404786.400448:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:12445:x1871083707924096:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:3.0:1784404786.400516:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400535:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400546:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400579:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400616:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400623:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400629:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404786.400634:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400641:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400653:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404786.400656:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784404786.400660:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.400666:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.400755:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:12445:x1871083707924096:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 309us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.400763:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 222 00000100:00100000:2.0:1784404786.404151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404786.404273:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707924352 00000100:00100000:0.0:1784404786.404284:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707924352 00000100:00100000:0.0:1784404786.404344:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:0.0:1784404786.404354:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+58:12445:x1871083707924352:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:0.0:1784404786.404585:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12445:x1871083707924352:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 231us (446us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1784404786.404604:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00010000:00010000:2.0:1784404786.436521:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404786.484985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.485530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707924608 00000100:00100000:3.0:1784404786.485542:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707924608 00000100:00100000:3.0:1784404786.485626:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 223 00000100:00100000:3.0:1784404786.485637:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12455:x1871083707924608:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404786.485661:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.485678:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784404786.485832:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79bf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74d7 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.485883:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404786.485889:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404786.485915:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed74fa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.486510:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.486528:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.486537:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.486579:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.486654:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 59 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.486672:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728936576:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404786.489978:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404786.491623:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728936576:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404786.491656:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404786.492385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.492506:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707924736 00000100:00100000:3.0:1784404786.492514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707924736 00010000:00010000:3.0:1784404786.492552:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 60 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.492612:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:3.0:1784404786.492623:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:2404:x1871083707924736:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404786.492641:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404786.492649:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 60 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.492662:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 60 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.492685:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79c68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74f3 expref: 60 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.492893:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404786.492909:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.492919:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.492926:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.492953:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404786.493016:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:2404:x1871083707924736:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 393us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.493024:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 97 00010000:00010000:2.0:1784404786.495749:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.495769:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404786.495820:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784404786.496057:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7e00/0x24b3e2e6dcd79c7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.496080:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.496090:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:2.0:1784404786.496092:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784404786.496096:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6200, rc 0) 00000100:00100000:2.0:1784404786.496162:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12455:x1871083707924608:12345-192.168.202.42@tcp:101:bash.0 Request processed in 10527us (11186us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1784404786.496171:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 223 00000100:00100000:2.0:1784404786.498625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.498955:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707924864 00000100:00100000:1.0:1784404786.498966:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707924864 00000100:00100000:1.0:1784404786.499029:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 224 00000100:00100000:1.0:1784404786.499039:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+59:12455:x1871083707924864:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404786.499064:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404786.499085:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79c92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7501 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.499121:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.499136:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.499161:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.499274:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759600/0x24b3e2e6dcd79c92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.499293:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.499301:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404786.499304:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404786.499308:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758c00, rc 0) 00000100:00100000:1.0:1784404786.499377:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:12455:x1871083707924864:12345-192.168.202.42@tcp:101:bash.0 Request processed in 339us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.499385:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 224 00000100:00100000:0.0:1784404786.504130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.510459:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707925120 00000100:00100000:3.0:1784404786.510489:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707925120 00000100:00100000:3.0:1784404786.510571:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 225 00000100:00100000:3.0:1784404786.510583:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+60:12455:x1871083707925120:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:3.0:1784404786.510826:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.510845:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.510917:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784404786.510962:0:9527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1784404786.510986:0:9527:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009440a932 reply state 0000000096c87de7 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.510999:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.511005:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404786.511008:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404786.511011:0:9527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404786.516913:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12455:x1871083707925120:12345-192.168.202.42@tcp:36:bash.0 Request processed in 6307us (12770us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1784404786.516928:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 225 00000020:00080000:2.0:1784404786.516936:0:9527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784404786.525666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404786.525965:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707925248 00000100:00100000:2.0:1784404786.525976:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707925248 00000100:00100000:2.0:1784404786.526043:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 226 00000100:00100000:2.0:1784404786.526056:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12455:x1871083707925248:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784404786.526083:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404786.526104:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79ca7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7508 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.526221:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.526237:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.526247:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.526285:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.526298:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 64 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404786.526311:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe63480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728936704:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404786.526444:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404786.531618:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe63480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728936704:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404786.531653:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404786.536234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.536339:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707925376 00000100:00100000:1.0:1784404786.536349:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707925376 00010000:00010000:1.0:1784404786.536395:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 65 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404786.536457:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 98 00000100:00100000:1.0:1784404786.536466:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:2404:x1871083707925376:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404786.536484:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404786.536491:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 65 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.536504:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 65 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.536561:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6200/0x24b3e2e6dcd79c84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74fa expref: 65 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.536578:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404786.536583:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.536597:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.536604:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.536639:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404786.536698:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:2404:x1871083707925376:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.536706:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 98 00010000:00010000:3.0:1784404786.536943:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.536952:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404786.537005:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784404786.537010:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404786.537031:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.537127:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79ca7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.537143:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.537151:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404786.537154:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404786.537163:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f000, rc 0) 00000100:00100000:3.0:1784404786.537192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12455:x1871083707925248:12345-192.168.202.42@tcp:101:bash.0 Request processed in 11139us (11536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.537199:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 226 00000100:00100000:0.0:1784404786.541381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404786.541452:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707925632 00000100:00100000:2.0:1784404786.541463:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707925632 00000100:00100000:2.0:1784404786.541528:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:2.0:1784404786.541539:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+63:12455:x1871083707925632:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:2.0:1784404786.541784:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12455:x1871083707925632:12345-192.168.202.42@tcp:35:bash.0 Request processed in 246us (414us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1784404786.541811:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:0.0:1784404786.608384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.608631:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707925760 00000100:00100000:3.0:1784404786.608641:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707925760 00000100:00100000:3.0:1784404786.608702:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 227 00000100:00100000:3.0:1784404786.608713:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+64:12461:x1871083707925760:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404786.608737:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.608757:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed750f expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.608827:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79cbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.608842:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.608888:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404786.608985:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1784404786.608989:0:13543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404786.609009:0:13543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.609035:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed750f expref: 66 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.609054:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79cbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed750f expref: 65 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.609062:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404786.609065:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404786.609069:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7a00, rc 0) 00000100:00100000:3.0:1784404786.609123:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12461:x1871083707925760:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 412us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.609131:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 227 00000100:00100000:0.0:1784404786.614630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404786.614692:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707925888 00000100:00100000:2.0:1784404786.614710:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707925888 00000100:00100000:2.0:1784404786.614771:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 228 00000100:00100000:2.0:1784404786.614779:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12461:x1871083707925888:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404786.614800:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404786.614821:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79cc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7516 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.614919:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.614932:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.614946:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.614957:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.614963:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.614970:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615048:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79cd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615071:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615076:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404786.615116:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784404786.615119:0:9527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404786.615135:0:9527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615145:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615150:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615154:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615158:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615162:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404786.615164:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615169:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615177:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404786.615180:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404786.615187:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615192:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79cca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615205:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615211:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615217:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615223:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404786.615225:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615231:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615239:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:2.0:1784404786.615241:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404786.615244:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615250:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79cd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615275:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79cc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7516 expref: 67 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615294:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7516 expref: 66 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404786.615299:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:2.0:1784404786.615300:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404786.615302:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e800, rc 0) 00000100:00100000:2.0:1784404786.615373:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12461:x1871083707925888:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 594us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404786.615380:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 228 00000100:00100000:0.0:1784404786.618430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.619051:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707926016 00000100:00100000:1.0:1784404786.619065:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707926016 00000100:00100000:1.0:1784404786.619147:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404786.619159:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:2403:x1871083707926016:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404786.619179:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404786.619222:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e800/0x24b3e2e6dcd79cd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7516 expref: 66 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.619246:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404786.619252:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404786.619344:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:2403:x1871083707926016:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 188us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.619352:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:0.0:1784404786.629339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.629433:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707926272 00000100:00100000:3.0:1784404786.629442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707926272 00000100:00100000:3.0:1784404786.629510:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 229 00000100:00100000:3.0:1784404786.629531:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12461:x1871083707926272:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404786.629552:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404786.629572:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed751d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.629683:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.629713:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.629722:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.629758:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.629772:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 66 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404786.629788:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728936832:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404786.629950:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e3fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404786.636458:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1871083728936832:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404786.636491:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404786.643470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.643557:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707926400 00000100:00100000:1.0:1784404786.643567:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707926400 00010000:00010000:1.0:1784404786.643612:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 67 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404786.643658:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 99 00000100:00100000:1.0:1784404786.643669:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:2403:x1871083707926400:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404786.643684:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404786.643691:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 67 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.643721:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 67 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.643744:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f000/0x24b3e2e6dcd79cae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7508 expref: 67 pid: 6520 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.643763:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404786.643769:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.643780:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.643788:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.643847:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404786.643933:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.643943:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404786.643966:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:1.0:1784404786.643980:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:2403:x1871083707926400:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 312us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.643989:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 99 00010000:00010000:3.0:1784404786.644101:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.644130:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.644138:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404786.644140:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784404786.644142:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6000, rc 0) 00000100:00100000:3.0:1784404786.644170:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12461:x1871083707926272:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 14642us (14853us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1784404786.644177:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 229 00000100:00100000:0.0:1784404786.656360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.656460:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707926656 00000100:00100000:1.0:1784404786.656471:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707926656 00000100:00100000:1.0:1784404786.656542:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1784404786.656553:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12461:x1871083707926656:12345-192.168.202.42@tcp:103:lfs.0 00010000:00010000:1.0:1784404786.656570:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404786.656597:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79c37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ec expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.656619:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404786.656624:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404786.656712:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12461:x1871083707926656:12345-192.168.202.42@tcp:103:lfs.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.656721:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:0.0:1784404786.661624:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404786.661956:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707926784 00000100:00100000:3.0:1784404786.661966:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707926784 00000100:00100000:3.0:1784404786.662027:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 230 00000100:00100000:3.0:1784404786.662037:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12461:x1871083707926784:12345-192.168.202.42@tcp:58:lfs.0 00010000:00010000:3.0:1784404786.662167:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.662185:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404786.662199:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784404786.662301:0:13543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1784404786.662388:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12461:x1871083707926784:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 351us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404786.662396:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 230 00000100:00100000:0.0:1784404786.666451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404786.666555:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707926912 00000100:00100000:1.0:1784404786.666565:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707926912 00000100:00100000:1.0:1784404786.666641:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 231 00000100:00100000:1.0:1784404786.666654:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+65:12461:x1871083707926912:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404786.666677:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404786.666711:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7524 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.666769:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.666795:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.666816:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.666831:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.666846:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404786.666888:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404786.666894:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404786.667060:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759a00, rc 0) 00000100:00100000:1.0:1784404786.667118:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12461:x1871083707926912:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 466us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404786.667126:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 231 00000100:00100000:0.0:1784404787.075298:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728936960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404787.075389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.075781:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728936960 00000100:00100000:3.0:1784404787.075805:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728936960 00000100:00100000:3.0:1784404787.075915:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784404787.075928:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728936960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404787.075952:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404787.076009:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728936960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.076017:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784404787.076060:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728936960:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1784404787.076186:0:9914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404960333091ns, next at 405960329909ns, rc = 0 00000040:00080000:1.0:1784404787.076271:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404787.076277:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404787.076318:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000100:00100000:2.0:1784404787.076320:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728937344:0@lo:400:kworker.0 00000040:00080000:1.0:1784404787.076326:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784404787.076413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.076439:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728937856:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.076462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.076481:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728938368:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.076507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.076532:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728937088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404787.076534:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784404787.076544:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728937472:0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.076570:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.076579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.076596:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728937600:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.076605:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728937984:0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.076625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.076641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.076651:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728938112:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.076666:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728938496:0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.076681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404787.076758:0:13786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d88e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728938880:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1784404787.076805:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404787.076823:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937344 00000100:00100000:0.0:1784404787.076828:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937344 00000100:00100000:0.0:1784404787.076905:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1784404787.076917:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728937344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.077631:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd4425dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728938624:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.077632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.077674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.077701:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1784404787.077703:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728938368 00000100:00100000:3.0:1784404787.077709:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728937216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404787.077710:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728938368 00000100:00100000:3.0:1784404787.077741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.077756:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937472 00000100:00100000:2.0:1784404787.077760:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937472 00000100:00100000:3.0:1784404787.077767:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728937728:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.077774:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937984 00000100:00100000:2.0:1784404787.077778:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937984 00000100:00100000:3.0:1784404787.077797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.077803:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728938112 00000100:00100000:2.0:1784404787.077807:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728938112 00000100:00100000:3.0:1784404787.077813:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57fe61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728938240:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.077824:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937728 00000100:00100000:2.0:1784404787.077827:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937728 00000100:00100000:3.0:1784404787.077847:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.077847:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784404787.077877:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728938368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.077881:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728938752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404787.077921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.077949:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728938368:12345-0@lo:400:kworker.0 Request processed in 73us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.077958:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937088 00000100:00100000:2.0:1784404787.077958:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784404787.077973:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937088 00000100:00100000:2.0:1784404787.077974:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728938240 00000100:00100000:2.0:1784404787.077979:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728938240 00000100:00100000:3.0:1784404787.078004:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937216 00000100:00100000:2.0:1784404787.078008:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1784404787.078010:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937216 00000100:00100000:2.0:1784404787.078017:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728937472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.078030:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728938752 00000100:00100000:3.0:1784404787.078034:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728938752 00000100:00100000:2.0:1784404787.078054:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728937472:12345-0@lo:400:kworker.0 Request processed in 37us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.078058:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784404787.078063:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1784404787.078069:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728937088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404787.078082:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1784404787.078092:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728937984:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784404787.078094:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784404787.078128:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728937984:12345-0@lo:400:kworker.0 Request processed in 38us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.078134:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1784404787.078146:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728937088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.078154:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784404787.078159:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784404787.078168:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728938112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.078176:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784404787.078185:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3648:x1871083728937216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404787.078197:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404787.078205:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728938112:12345-0@lo:400:kworker.0 Request processed in 38us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.078213:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784404787.078230:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784404787.078234:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3648:x1871083728937216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.078242:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728937728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.078246:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784404787.078265:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784404787.078274:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728938752:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404787.078283:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728937728:12345-0@lo:400:kworker.0 Request processed in 43us (484us total) trans 0 rc 0/0 00002000:00000024:3.0:1784404787.078285:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784404787.078295:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784404787.078312:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784404787.078320:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728938752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.078321:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728938240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.078329:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784404787.078352:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937856 00000100:00100000:3.0:1784404787.078355:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937856 00000100:00100000:3.0:1784404787.078379:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728937600 00000100:00100000:3.0:1784404787.078382:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728937600 00000100:00100000:3.0:1784404787.078395:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784404787.078525:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728938240:12345-0@lo:400:kworker.0 Request processed in 206us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.078532:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784404787.078568:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728937472:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.078579:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728937984:0@lo:400:kworker.0 00010000:00080000:2.0:1784404787.078592:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443528000 x1871083728938368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404787.078602:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728938368:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.078654:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728938496 00000100:00100000:2.0:1784404787.078657:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728938496 00000100:00100000:2.0:1784404787.078674:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728938624 00000100:00100000:2.0:1784404787.078676:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728938624 00000100:00100000:2.0:1784404787.078999:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784404787.079015:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728938496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.079056:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728938496:12345-0@lo:400:kworker.0 Request processed in 42us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.079063:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784404787.079077:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784404787.079084:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728938624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.079111:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728938624:12345-0@lo:400:kworker.0 Request processed in 28us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.079117:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784404787.079142:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728938496:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.079195:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728937216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404787.079207:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728937728:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.079217:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728938240:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.079227:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728938752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404787.079255:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728937088:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784404787.079595:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57fe62300 x1871083728938112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404787.079607:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728938112:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.079616:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd4425dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728938624:0@lo:400:kworker.0 00000100:00080000:2.0:1784404787.079667:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404787.079673:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404787.079675:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404787.082059:0:13786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784404787.083527:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54af54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728937344:12345-0@lo:400:kworker.0 Request processed in 6604us (7107us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404787.083540:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1784404787.083604:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728937344:0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.085220:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784404787.085302:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728937600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404787.085820:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728937600:12345-0@lo:400:kworker.0 Request processed in 588us (9195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.085829:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784404787.085958:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728937600:0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.087303:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4425de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728937856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404787.087462:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4425de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728937856:12345-0@lo:400:kworker.0 Request processed in 109us (10935us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.087474:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784404787.087600:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57fe62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728937856:0@lo:400:kworker.0 00000100:00100000:0.0:1784404787.087848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404787.087945:0:13786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d88e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728938880:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784404787.088076:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707927040 00000100:00100000:2.0:1784404787.088083:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707927040 00000100:00100000:2.0:1784404787.088133:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 232 00000100:00100000:2.0:1784404787.088141:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12462:x1871083707927040:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784404787.088162:0:9527:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784404787.088264:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12462:x1871083707927040:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 123us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.088271:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 232 00000100:00100000:1.0:1784404787.099277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.100015:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707927168 00000100:00100000:2.0:1784404787.100027:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707927168 00000100:00100000:2.0:1784404787.100101:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 233 00000100:00100000:2.0:1784404787.100111:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12462:x1871083707927168:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.100202:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100230:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100244:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100271:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100278:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100285:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100306:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100314:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100320:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404787.100371:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784404787.100376:0:13543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404787.100391:0:13543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100416:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100423:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100430:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100446:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404787.100450:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100457:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100470:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:2.0:1784404787.100473:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404787.100476:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100482:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100494:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100500:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100506:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100511:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404787.100513:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100519:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100536:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9dd443416b00) 00010000:00010000:2.0:1784404787.100538:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404787.100541:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100548:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100563:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100570:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100576:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100580:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404787.100583:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100589:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100594:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:2.0:1784404787.100596:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404787.100599:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.100604:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.100838:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12462:x1871083707927168:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 726us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.100847:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 233 00000100:00100000:1.0:1784404787.120618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.120702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707927424 00000100:00100000:2.0:1784404787.120712:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707927424 00000100:00100000:2.0:1784404787.120764:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 234 00000100:00100000:2.0:1784404787.120771:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+66:12462:x1871083707927424:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.120792:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404787.120823:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed752b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.120983:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.120999:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121013:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404787.121026:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784404787.121132:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121140:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121146:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121177:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404787.121198:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121206:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121225:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:2.0:1784404787.121228:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784404787.121233:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121239:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121286:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed752b expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121297:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:2.0:1784404787.121299:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404787.121302:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed752b expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.121312:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516ea00, rc 0) 00000100:00100000:2.0:1784404787.121384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:12462:x1871083707927424:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 611us (774us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1784404787.121393:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 234 00000100:00100000:2.0:1784404787.123934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404787.124088:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707927552 00000100:00100000:1.0:1784404787.124100:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707927552 00000100:00100000:1.0:1784404787.124166:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 235 00000100:00100000:1.0:1784404787.124177:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:12462:x1871083707927552:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784404787.124219:0:6519:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784404787.124337:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:12462:x1871083707927552:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 162us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404787.124345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 235 00000100:00100000:1.0:1784404787.133791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.133914:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707927808 00000100:00100000:2.0:1784404787.133926:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707927808 00000100:00100000:2.0:1784404787.133992:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 236 00000100:00100000:2.0:1784404787.134340:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5704c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:12462:x1871083707927808:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.134362:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404787.134365:0:13543:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784404787.134390:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7a00/0x24b3e2e6dcd79cbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed750f expref: 67 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.134409:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:2.0:1784404787.134414:0:13543:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404787.134427:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d2c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7532 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784404787.134780:0:13543:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1784404787.135265:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.135278:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.135288:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.135331:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7532 expref: 69 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.135345:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7532 expref: 68 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.135373:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416b00) 00010000:00010000:2.0:1784404787.135375:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404787.135378:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f200, rc 0) 00000100:00100000:2.0:1784404787.135447:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5704c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:12462:x1871083707927808:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1112us (1679us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1784404787.137176:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 236 00000100:00100000:2.0:1784404787.147054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404787.147224:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707928064 00000100:00100000:1.0:1784404787.147234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707928064 00000100:00100000:1.0:1784404787.147301:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 237 00000100:00100000:1.0:1784404787.147319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:12462:x1871083707928064:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784404787.147383:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404787.147571:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7532 expref: 68 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.147658:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416b00) 00010000:00010000:1.0:1784404787.147670:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404787.147782:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.148015:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.148029:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148123:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148142:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148149:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148190:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148198:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148204:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148210:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404787.148215:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148223:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148231:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404787.148234:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404787.148238:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148244:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759400/0x24b3e2e6dcd79d41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148254:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148265:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148271:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148276:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784404787.148279:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148285:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148293:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6b8be153 (ffff9dd443310a00) 00010000:00010000:0.0:1784404787.148296:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404787.148299:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.148304:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd79d48 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6b8be153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404787.148416:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:12462:x1871083707928064:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1105us (1370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784404787.148424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 237 00000100:00100000:0.0:1784404787.152638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.152736:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707928192 00000100:00100000:2.0:1784404787.152746:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707928192 00000100:00100000:2.0:1784404787.152809:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 238 00000100:00100000:2.0:1784404787.152821:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+67:12462:x1871083707928192:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.152844:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404787.152908:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7539 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.152943:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.152956:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.152969:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.153082:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ea00/0x24b3e2e6dcd79d4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 69 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.153113:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 68 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.153123:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:2.0:1784404787.153126:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784404787.153128:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516ee00, rc 0) 00000100:00100000:2.0:1784404787.153197:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:12462:x1871083707928192:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 378us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.153205:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 238 00000100:00100000:1.0:1784404787.157492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.157549:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707928448 00000100:00100000:2.0:1784404787.157561:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707928448 00000100:00100000:2.0:1784404787.157632:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 239 00000100:00100000:2.0:1784404787.157644:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+68:12462:x1871083707928448:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.157736:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.157755:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.157766:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404787.162180:0:13543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1784404787.162264:0:13543:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000574a9a2a reply state 00000000b3d9a255 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.162286:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.162312:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:2.0:1784404787.162315:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784404787.162318:0:13543:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404787.162455:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+70:12462:x1871083707928448:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 4808us (4967us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1784404787.162465:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 239 00000100:00100000:1.0:1784404787.165134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.165242:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707928576 00000100:00100000:2.0:1784404787.165252:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707928576 00000100:00100000:2.0:1784404787.165308:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 240 00000100:00100000:2.0:1784404787.165319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+70:12462:x1871083707928576:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.165343:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404787.165372:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7540 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.165433:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.165450:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.165470:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:2.0:1784404787.165473:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784404787.165477:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f600, rc 0) 00000100:00100000:2.0:1784404787.165536:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+71:12462:x1871083707928576:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 219us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.165544:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 240 00000100:00100000:1.0:1784404787.168605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.168721:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707928704 00000100:00100000:2.0:1784404787.168732:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707928704 00000100:00100000:2.0:1784404787.168804:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1784404787.168813:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2402:x1871083707928704:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784404787.168881:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404787.169033:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2402:x1871083707928704:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 220us (447us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1784404787.169040:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:3.0:1784404787.171482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404787.171553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707928960 00000100:00100000:0.0:1784404787.171563:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707928960 00000100:00100000:0.0:1784404787.171621:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:0.0:1784404787.171632:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+71:12462:x1871083707928960:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784404787.171908:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+72:12462:x1871083707928960:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 277us (434us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1784404787.171917:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:1.0:1784404787.173969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.174083:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707929216 00000100:00100000:2.0:1784404787.174092:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707929216 00000100:00100000:2.0:1784404787.174151:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:2.0:1784404787.174161:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+72:12462:x1871083707929216:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784404787.174267:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+72:12462:x1871083707929216:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.174274:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 241 00000100:00100000:1.0:1784404787.177292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404787.177479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707929344 00000100:00100000:3.0:1784404787.177491:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707929344 00000100:00100000:3.0:1784404787.177552:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:3.0:1784404787.177563:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+72:12462:x1871083707929344:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404787.177594:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404787.177618:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79d6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7547 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.177813:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79d72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.177828:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79d72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.177925:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79d72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404787.177975:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404787.177996:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79d72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.178022:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7000/0x24b3e2e6dcd79d6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7547 expref: 74 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.178039:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79d72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7547 expref: 73 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.178226:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:3.0:1784404787.178230:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784404787.178233:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6e00, rc 0) 00000100:00100000:3.0:1784404787.178411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+73:12462:x1871083707929344:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 849us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.178419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 242 00000100:00100000:1.0:1784404787.184798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.185012:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707929472 00000100:00100000:2.0:1784404787.185024:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707929472 00000100:00100000:2.0:1784404787.185121:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:2.0:1784404787.185133:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+10:2404:x1871083707929472:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.185155:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404787.185177:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed754e expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784404787.185205:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bdb33, blocks: 0x0 00010000:00010000:2.0:1784404787.185229:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1784404787.185233:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404787.185244:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.185283:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.185298:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516ea00, rc 0) 00000100:00100000:2.0:1784404787.185361:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:2404:x1871083707929472:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 229us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.185368:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:1.0:1784404787.187609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.187782:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707929728 00000100:00100000:2.0:1784404787.187792:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707929728 00000100:00100000:2.0:1784404787.187948:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 243 00000100:00100000:2.0:1784404787.187959:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+73:12462:x1871083707929728:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784404787.188061:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+73:12462:x1871083707929728:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 104us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.188069:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 243 00000100:00100000:0.0:1784404787.189806:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.189882:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707929856 00000100:00100000:2.0:1784404787.189888:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707929856 00000100:00100000:2.0:1784404787.189952:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:2.0:1784404787.189961:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:12462:x1871083707929856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.189977:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404787.189998:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7555 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.190031:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.190063:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404787.190068:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404787.190074:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.190119:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.190135:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 12 pid: 8434 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.190154:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728939008:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404787.190353:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8e840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404787.193678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404787.193766:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707929984 00000100:00100000:0.0:1784404787.193775:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707929984 00010000:00010000:0.0:1784404787.193818:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 13 pid: 8434 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404787.193920:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 100 00000100:00100000:0.0:1784404787.193932:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:2403:x1871083707929984:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404787.193949:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404787.193972:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 13 pid: 8434 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.193986:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 13 pid: 8434 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.194012:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404787.194016:0:10336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404787.194024:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.194035:0:10336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.194092:0:10336:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 13 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404787.194106:0:10336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10336:1871083728939136:192.168.202.42@tcp:105: 00000100:00100000:0.0:1784404787.194181:0:10336:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4434789c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784404787.195229:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed754e expref: 13 pid: 8434 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.195248:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1871083728939008:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404787.195273:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.195285:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e000, rc 0) 00000100:00100000:2.0:1784404787.195370:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:12462:x1871083707929856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 5409us (5569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.195391:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:0.0:1784404787.197637:0:10336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cc9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10336:1871083728939136:192.168.202.42@tcp:105: 00010000:00010000:0.0:1784404787.197665:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404787.197762:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:2403:x1871083707929984:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 3833us (4093us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404787.197773:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 100 00000100:00100000:1.0:1784404787.205475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404787.205556:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707930112 00000100:00100000:3.0:1784404787.205565:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707930112 00002000:00100000:3.0:1784404787.205628:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9dd443d8a680 x1871083707930112/t0(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:48/0 lens 504/0 e 0 to 0 dl 1784404798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784404787.205640:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443d8a680 with x1871083707930112 ext(0->12) 00002000:00010000:3.0:1784404787.205646:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443d8a680 00000100:00100000:3.0:1784404787.205684:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:3.0:1784404787.205702:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+11:2404:x1871083707930112:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784404787.206999:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:2404:x1871083707930112:12345-192.168.202.42@tcp:4:lhsmtool_posix.0 Request processed in 1300us (1528us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1784404787.207014:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00002000:00100000:0.0:1784404787.207024:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9dd443d8a680 x1871083707930112/t4294967321(0) o4->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:48/0 lens 504/448 e 0 to 0 dl 1784404798 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784404787.207034:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443d8a680 with x1871083707930112 ext(0->12) 00002000:00010000:0.0:1784404787.207040:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443d8a680 00000100:00100000:3.0:1784404787.209433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.209545:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707930240 00000100:00100000:2.0:1784404787.209555:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707930240 00000100:00100000:2.0:1784404787.209679:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 244 00000100:00100000:2.0:1784404787.209754:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+73:12462:x1871083707930240:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784404787.211738:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1784404787.211759:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1784404787.211824:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1784404787.211844:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd54133a480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1784404787.211875:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd57c8f5b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd541671cc0 00000020:00080000:2.0:1784404787.211879:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd57c8f5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd441a53800 00000004:00080000:2.0:1784404787.211926:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1784404787.211950:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd4435e3600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1784404787.211954:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd54870ff00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4435e3780 00000020:00080000:2.0:1784404787.211956:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd54870fb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd56250a200 00000020:00080000:2.0:1784404787.211966:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1784404787.211983:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1784404787.212062:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1784404787.212116:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404787.212138:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728939264:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784404787.212188:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12462:x1871083707930240:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 2497us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.212200:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 244 00000100:00100000:0.0:1784404787.212337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404787.212537:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728939264 00000100:00100000:2.0:1784404787.212545:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728939264 00000100:00100000:2.0:1784404787.212597:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784404787.212607:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728939264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784404787.212641:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1784404787.212666:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.212686:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 12 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.212707:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784404787.212712:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784404787.212717:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.212744:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 12 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.212758:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 12 pid: 8488 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.212770:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728939520:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404787.213048:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8e840 going to sleep for 11 seconds 00000100:00100000:0.0:1784404787.214208:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728939392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784404787.214267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.214378:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728939392 00000100:00100000:3.0:1784404787.214385:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728939392 00000100:00100000:3.0:1784404787.214430:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784404787.214439:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1871083728939392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784404787.214464:0:8488:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1784404787.214493:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a5bdb32, atime: 0x6a5bdb32, ctime: 0x6a5bdb32, blocks: 0x8 00010000:00010000:3.0:1784404787.214500:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.214530:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:3.0:1784404787.214534:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404787.214541:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.214557:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.214567:0:8488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.214575:0:8488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.214610:0:8488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784404787.214782:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3647:x1871083728939392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (514us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1784404787.214790:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1784404787.215121:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404787.215134:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.215143:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404787.215147:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.215155:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.215172:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.215180:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5a78ad/0x24b3e2e6dcd79d8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.215198:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404787.215200:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404787.215202:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784404787.215235:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd443d31880/2, rc 0, transno 4294967311 00000100:00100000:0.0:1784404787.215242:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728939392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784404787.216554:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.216688:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1871083728939520:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404787.216726:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404787.216998:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707930368 00000100:00100000:0.0:1784404787.217005:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707930368 00010000:00010000:0.0:1784404787.217037:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 13 pid: 8488 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404787.217068:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 101 00000100:00100000:0.0:1784404787.217092:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+13:2403:x1871083707930368:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784404787.217107:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404787.217113:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 13 pid: 8488 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217126:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 13 pid: 8488 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217147:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd79b3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed74ad expref: 13 pid: 8488 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217163:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404787.217167:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784404787.217172:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217181:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217208:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404787.217256:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:2403:x1871083707930368:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 165us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404787.217261:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 101 00010000:00010000:0.0:1784404787.217278:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217292:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217299:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217303:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217314:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784404787.217502:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1871083728939264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4898us (5307us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1784404787.217507:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1784404787.217521:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404787.217525:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217530:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404787.217533:0:10394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217538:0:10394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217549:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217563:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000119eb43d/0x24b3e2e6dcd79d87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404787.217578:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404787.217591:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404787.217593:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784404787.217617:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd443cc9500/2, rc 0, transno 4294967322 00000100:00100000:0.0:1784404787.217625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728939264:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784404787.218699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404787.218784:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707930496 00000100:00100000:3.0:1784404787.218802:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707930496 00010000:00010000:1.0:1784404787.218820:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218831:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218838:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218844:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.218860:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404787.218867:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 75 00010000:00010000:1.0:1784404787.218868:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404787.218876:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+12:2404:x1871083707930496:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1784404787.218882:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9dd54955fd00) 00010000:00010000:1.0:1784404787.218885:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404787.218888:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218915:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd79a85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218955:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218962:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218968:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218973:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151bc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.218976:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218982:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.218991:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9dd443416400) 00010000:00010000:1.0:1784404787.218993:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404787.218996:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219127:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79b2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219147:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219154:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219165:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219170:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516fe00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.219173:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219179:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219186:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:1.0:1784404787.219188:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404787.219191:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219196:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fe00/0x24b3e2e6dcd79bab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219209:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219215:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219220:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219225:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.219227:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219241:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219249:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416c00) 00010000:00010000:1.0:1784404787.219251:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404787.219254:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219259:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54167e200/0x24b3e2e6dcd79bce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219277:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219284:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219290:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219295:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.219297:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219302:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219309:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404787.219311:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404787.219415:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219433:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79ca0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219448:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219454:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219460:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219464:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.219467:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219472:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219480:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:1.0:1784404787.219483:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784404787.219486:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.219492:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79d5d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404787.220266:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1784404787.220274:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1784404787.220425:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2404:x1871083707930496:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 1547us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.220447:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 75 00000100:00100000:0.0:1784404787.223712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404787.223798:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707930752 00000100:00100000:3.0:1784404787.223808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707930752 00000100:00100000:3.0:1784404787.223917:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:3.0:1784404787.223928:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:12462:x1871083707930752:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784404787.223987:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404787.224013:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79d72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7547 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.224031:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:3.0:1784404787.224036:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404787.224066:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.224081:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.224091:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404787.224221:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072a4eed3 reply state 00000000573fc5eb transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.224233:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.224239:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:3.0:1784404787.224242:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404787.224258:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404787.224412:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:12462:x1871083707930752:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 485us (718us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1784404787.224419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 245 00000100:00100000:1.0:1784404787.226737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.226828:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707930880 00000100:00100000:2.0:1784404787.226838:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707930880 00000100:00100000:2.0:1784404787.227121:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:2.0:1784404787.227134:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707930880:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784404787.227290:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784404787.227293:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1784404787 00002000:00010000:2.0:1784404787.227295:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1784404786 00002000:00010000:2.0:1784404787.227297:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1784404787 -> 1784404787 00002000:00010000:2.0:1784404787.227298:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1784404787.227466:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2402:x1871083707930880:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 334us (736us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784404787.227474:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 76 00000100:00100000:2.0:1784404787.229221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404787.229290:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707931136 00000100:00100000:1.0:1784404787.229301:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707931136 00000100:00100000:1.0:1784404787.229458:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:1.0:1784404787.229482:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:12462:x1871083707931136:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784404787.229625:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.229647:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.229654:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.229690:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.229703:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 22 pid: 9527 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.229720:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728939648:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404787.229828:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3180 going to sleep for 11 seconds 00000100:00100000:0.0:1784404787.231820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.232012:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707931264 00000100:00100000:2.0:1784404787.232020:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707931264 00010000:00010000:2.0:1784404787.232059:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 23 pid: 9527 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.232098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 102 00000100:00100000:2.0:1784404787.232108:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+23:2404:x1871083707931264:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404787.232123:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404787.232130:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 23 pid: 9527 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.232143:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 23 pid: 9527 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.232191:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:2.0:1784404787.232196:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232197:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ee00/0x24b3e2e6dcd79d56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7539 expref: 23 pid: 9527 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.232206:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.232213:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.232213:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728939648:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404787.232229:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784404787.232232:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232240:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232253:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.232285:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2404:x1871083707931264:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 178us (474us total) trans 0 rc 0/0 00010000:00010000:1.0:1784404787.232291:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.232292:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 102 00010000:00010000:1.0:1784404787.232298:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232304:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232310:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.232723:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232735:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232746:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:1.0:1784404787.232749:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784404787.232753:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.232759:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd79d9c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.233022:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:12462:x1871083707931136:12345-192.168.202.42@tcp:55:lhsmtool_posix.0 Request processed in 3542us (3807us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784404787.233037:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 246 00000100:00100000:0.0:1784404787.234993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.235043:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707931392 00000100:00100000:2.0:1784404787.235053:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707931392 00000100:00100000:2.0:1784404787.235112:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:2.0:1784404787.235123:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2401:x1871083707931392:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.235165:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.235187:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.235196:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404787.235200:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784404787.235205:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.235266:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.235279:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 8 pid: 8433 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.235294:0:8488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1871083728939776:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404787.235370:0:8488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8e840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404787.237419:0:8488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1871083728939776:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404787.237448:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404787.237689:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404787.237765:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707931520 00000100:00100000:1.0:1784404787.237771:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707931520 00010000:00010000:1.0:1784404787.237807:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 9 pid: 8433 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.237876:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 103 00000100:00100000:1.0:1784404787.237887:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+9:2403:x1871083707931520:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404787.237914:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404787.237935:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 9 pid: 8433 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.237947:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 9 pid: 8433 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.237971:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013aaa9dc/0x24b3e2e6dcd79d80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7555 expref: 9 pid: 8433 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.237987:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784404787.237991:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784404787.237997:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.238005:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.238036:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404787.238050:0:8488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.238059:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.238080:0:8488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.238087:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707931520:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 202us (399us total) trans 0 rc 0/0 00010000:00010000:2.0:1784404787.238089:0:8488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.238107:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 103 00010000:00010000:2.0:1784404787.238108:0:8488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.238115:0:8488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404787.238120:0:8488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.238129:0:8488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.238141:0:8488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.238149:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d318366/0x24b3e2e6dcd79da3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.238195:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2401:x1871083707931392:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 3074us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.238202:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 77 00000100:00100000:3.0:1784404787.239687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.239994:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707931776 00000100:00100000:2.0:1784404787.240003:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707931776 00000100:00100000:2.0:1784404787.240095:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 247 00000100:00100000:2.0:1784404787.240105:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:12462:x1871083707931776:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784404787.240173:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.240198:0:13543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.240205:0:13543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.240234:0:13543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.240243:0:13543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 21 pid: 6521 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.240255:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728939904:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404787.240323:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8e840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404787.242341:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728939904:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404787.242367:0:13543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404787.243079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.243164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707931904 00000100:00100000:2.0:1784404787.243171:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707931904 00010000:00010000:2.0:1784404787.243208:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 22 pid: 6521 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.243286:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 104 00000100:00100000:2.0:1784404787.243295:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2404:x1871083707931904:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404787.243310:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404787.243328:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 22 pid: 6521 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.243340:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 22 pid: 6521 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.243362:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758c00/0x24b3e2e6dcd79c99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7501 expref: 22 pid: 6521 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.243378:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:2.0:1784404787.243383:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.243393:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.243401:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.243409:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.243436:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404787.243485:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:2404:x1871083707931904:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 191us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.243493:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 104 00010000:00010000:3.0:1784404787.243551:0:13543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.243559:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.243785:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.243803:0:13543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.243811:0:13543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.243837:0:13543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.243875:0:13543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 21 pid: 6519 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404787.243890:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728940032:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404787.243965:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e3fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404787.248794:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728940032:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404787.248835:0:13543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.249570:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.249985:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707932032 00000100:00100000:2.0:1784404787.249996:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707932032 00010000:00010000:2.0:1784404787.250035:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 22 pid: 6519 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.250098:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 105 00000100:00100000:2.0:1784404787.250109:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570559450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2401:x1871083707932032:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404787.250129:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404787.250136:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 22 pid: 6519 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.250147:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 22 pid: 6519 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.250169:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79d64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7540 expref: 22 pid: 6519 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.250185:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:2.0:1784404787.250191:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.250200:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.250208:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.250232:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404787.250301:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570559450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:2401:x1871083707932032:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 193us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.250309:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 105 00010000:00010000:3.0:1784404787.250703:0:13543:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.250713:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784404787.250835:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1784404787.250997:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1784404787.251034:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1784404787.251114:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728940160:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784404787.251167:0:13543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404787.251199:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd558cb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404787.251316:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728940160 00000100:00100000:2.0:1784404787.251330:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728940160 00000100:00100000:2.0:1784404787.251367:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784404787.251375:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13543:x1871083728940160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784404787.251458:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13543:x1871083728940160:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404787.251465:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784404787.251553:0:13543:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1784404787.251559:0:13543:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1784404787.251577:0:13543:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd443cc9500, transno 4294967322 00000100:00100000:1.0:1784404787.251605:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728940160:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1784404787.251983:0:13543:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1784404787.252029:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728940288:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784404787.252064:0:13543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404787.252089:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728940288 00000100:00100000:1.0:1784404787.252093:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728940288 00000100:00100000:1.0:1784404787.252118:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784404787.252124:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13543:x1871083728940288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784404787.252218:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13543:x1871083728940288:12345-0@lo:1000:mdt00_004.0 Request processed in 94us (153us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1784404787.252226:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784404787.252242:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404787.252258:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13543:1871083728940288:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1784404787.252287:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252295:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252302:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252320:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.252324:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252332:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252347:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:1.0:1784404787.252350:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404787.252355:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252360:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7200/0x24b3e2e6dcd79db1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252385:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252390:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252396:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252400:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404787.252403:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252409:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252428:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404787.252430:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404787.252438:0:13543:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252450:0:13543:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252458:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.252482:0:13543:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.252492:0:13543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728940416:192.168.202.42@tcp:105: 00000100:00100000:1.0:1784404787.252539:0:13543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404787.255477:0:13543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13543:1871083728940416:192.168.202.42@tcp:105: 00010000:00010000:3.0:1784404787.255509:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255519:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79cf4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255558:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255571:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255592:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255621:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255632:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255638:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255645:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404787.255648:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255656:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255667:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404787.255670:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404787.255674:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255679:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79db8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255698:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255705:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255711:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255722:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404787.255726:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255731:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255741:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404787.255743:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784404787.255746:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.255751:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e400/0x24b3e2e6dcd79daa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404787.255965:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:12462:x1871083707931776:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 15859us (16282us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1784404787.255976:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 247 00000020:00080000:3.0:1784404787.255982:0:13543:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784404787.256220:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404787.256226:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404787.256716:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1784404787.256725:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784404787.258265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404787.258344:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707932160 00000100:00100000:3.0:1784404787.258354:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707932160 00000100:00100000:3.0:1784404787.258410:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:3.0:1784404787.258422:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:12461:x1871083707932160:12345-192.168.202.42@tcp:49:lfs.0 00000100:00100000:3.0:1784404787.258664:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+24:12461:x1871083707932160:12345-192.168.202.42@tcp:49:lfs.0 Request processed in 243us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.258672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:0.0:1784404787.264243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404787.264288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.264305:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707932416 00000100:00100000:3.0:1784404787.264354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707932672 00000100:00100000:3.0:1784404787.264361:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707932672 00000100:00100000:3.0:1784404787.264473:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:2.0:1784404787.264473:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707932416 00000100:00100000:3.0:1784404787.264484:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:12462:x1871083707932672:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784404787.264564:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 248 00000100:00100000:2.0:1784404787.264573:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+25:12461:x1871083707932416:12345-192.168.202.42@tcp:58:lfs.0 00000040:00080000:2.0:1784404787.264698:0:9527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1784404787.264779:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:12461:x1871083707932416:12345-192.168.202.42@tcp:58:lfs.0 Request processed in 207us (544us total) trans 0 rc 0/0 00000004:00080000:3.0:1784404787.264784:0:6522:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1784404787.264787:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 248 00000001:00080000:3.0:1784404787.264832:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1784404787.264909:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.264929:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.264941:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.264951:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.264958:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.264968:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.264990:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784404787.265044:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:12462:x1871083707932672:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 561us (754us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1784404787.265051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000020:00080000:3.0:1784404787.265055:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784404787.265963:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404787.265973:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.265982:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404787.265986:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.265994:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.266010:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:2.0:1784404787.266013:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784404787.266017:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.266042:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7400/0x24b3e2e6dcd79dbf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.266057:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404787.266058:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404787.266060:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404787.295347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404787.295411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707932800 00000100:00100000:2.0:1784404787.295421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707932800 00000100:00100000:2.0:1784404787.295523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 249 00000100:00100000:2.0:1784404787.295534:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+26:12464:x1871083707932800:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404787.295571:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404787.295603:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79dc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed755c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.295676:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.295692:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.295705:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.295721:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.295729:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.295735:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.296041:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.296053:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.296061:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.296099:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404787.296113:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 27 pid: 6520 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404787.296128:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728940544:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404787.296235:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404787.300947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404787.301099:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1871083728940544:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404787.301129:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404787.301557:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707933056 00000100:00100000:0.0:1784404787.301566:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707933056 00000100:00100000:0.0:1784404787.301684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:0.0:1784404787.301695:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+28:6171:x1871083707933056:12345-192.168.202.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784404787.302006:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:6171:x1871083707933056:12345-192.168.202.42@tcp:35:ldlm_bl.0 Request processed in 313us (1069us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1784404787.302015:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:0.0:1784404787.305220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404787.305340:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707933184 00000100:00100000:1.0:1784404787.305357:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707933184 00010000:00010000:1.0:1784404787.305401:0:10336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 29 pid: 6520 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.305450:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 106 00000100:00100000:1.0:1784404787.305459:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:2403:x1871083707933184:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404787.305475:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404787.305482:0:10336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 29 pid: 6520 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.305497:0:10336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 29 pid: 6520 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.305523:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6000/0x24b3e2e6dcd79ce6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed751d expref: 29 pid: 6520 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.305551:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:1.0:1784404787.305557:0:10336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.305566:0:10336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.305576:0:10336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404787.305616:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404787.305717:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+28:2403:x1871083707933184:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 258us (507us total) trans 0 rc 0/0 00010000:00010000:3.0:1784404787.305718:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305727:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404787.305733:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 106 00000004:00200000:3.0:1784404787.305788:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784404787.305792:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404787.305812:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305825:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305836:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305880:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305887:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305902:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404787.305906:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305914:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305924:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:3.0:1784404787.305927:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404787.305931:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305937:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79dcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305960:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305966:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305972:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305978:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ec00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404787.305980:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305986:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.305995:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9dd443416e00) 00010000:00010000:3.0:1784404787.305997:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404787.306000:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.306005:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd79dd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.306180:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd79dc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed755c expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.306196:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed755c expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404787.306213:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404787.306215:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784404787.306217:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e200, rc 0) 00000100:00100000:3.0:1784404787.306249:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12464:x1871083707932800:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 10717us (10910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404787.306256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 249 00010000:00010000:2.0:1784404787.459097:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784404788.145777:0:14705:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404788.145788:0:14705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404788.145935:0:14705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784404788.145942:0:14705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1784404788.295523:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784404788.295535:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784404788.295564:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784404788.295570:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784404788.296507:0:13786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728940672:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784404788.298708:0:13786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404788.313311:0:13786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13786:1871083728940672:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784404788.323256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404788.323790:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707933312 00000100:00100000:3.0:1784404788.323802:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707933312 00000100:00100000:3.0:1784404788.323923:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:3.0:1784404788.323935:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12476:x1871083707933312:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1784404788.323955:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1784404788.323976:0:13543:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784404788.324102:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12476:x1871083707933312:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 169us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404788.334531:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 250 00000100:00100000:0.0:1784404788.334845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404788.335053:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707933568 00000100:00100000:2.0:1784404788.335064:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707933568 00000100:00100000:2.0:1784404788.335142:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:2.0:1784404788.335154:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+27:12476:x1871083707933568:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404788.335179:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404788.335255:0:9527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79de2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7563 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404788.335382:0:9527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79de9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404788.335397:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404788.335411:0:9527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404788.335424:0:9527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784404788.335544:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f800/0x24b3e2e6dcd79de2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7563 expref: 30 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404788.335563:0:9527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7563 expref: 29 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404788.335572:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:2.0:1784404788.335575:0:9527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404788.335579:0:9527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f600, rc 0) 00000100:00100000:2.0:1784404788.335645:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:12476:x1871083707933568:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 493us (800us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1784404788.335653:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 251 00000100:00100000:0.0:1784404788.340213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404788.340378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707933696 00000100:00100000:3.0:1784404788.340389:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707933696 00000100:00100000:3.0:1784404788.340456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:3.0:1784404788.340467:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:2404:x1871083707933696:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404788.340482:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404788.340516:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd79de9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7563 expref: 29 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.340534:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404788.340556:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404788.340627:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+28:2404:x1871083707933696:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 161us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404788.340635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1784404788.341475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404788.341524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707933952 00000100:00100000:3.0:1784404788.341531:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707933952 00000100:00100000:3.0:1784404788.342518:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 252 00000100:00100000:3.0:1784404788.342541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+28:12476:x1871083707933952:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784404788.342634:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.342651:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.342674:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.342972:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.342981:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.342988:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.342994:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404788.342998:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.343006:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.343031:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404788.343034:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784404788.343039:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404788.343046:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79df7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404788.343179:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:12476:x1871083707933952:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 647us (1706us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1784404788.343190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 252 00000040:00080000:2.0:1784404788.343547:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784404788.343558:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784404788.344139:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1784404788.344148:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784404788.348382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404788.348775:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707934208 00000100:00100000:3.0:1784404788.348796:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707934208 00000100:00100000:3.0:1784404788.349073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:3.0:1784404788.349086:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+29:12476:x1871083707934208:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784404788.349330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:12476:x1871083707934208:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 248us (964us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1784404788.349338:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00010000:00010000:0.0:1784404788.485407:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404788.611441:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404788.611474:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728940800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404788.611597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404788.611944:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728940800 00000100:00100000:1.0:1784404788.611952:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728940800 00000100:00100000:1.0:1784404788.612010:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784404788.612019:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728940800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404788.612052:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784404788.612107:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728940800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404788.612114:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784404788.613168:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728940800:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1784404789.133226:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1784404789.133251:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1784404789.454985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404789.455052:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707934464 00000100:00100000:1.0:1784404789.455063:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707934464 00000100:00100000:0.0:1784404789.455073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404789.455113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404789.455153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404789.455174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404789.455231:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707934720 00000100:00100000:2.0:1784404789.455236:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707934720 00000100:00100000:2.0:1784404789.455281:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:2.0:1784404789.455291:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707934720:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404789.455365:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707934720:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404789.455372:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 87 00000100:00100000:1.0:1784404789.455457:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707934976 00000100:00100000:1.0:1784404789.455461:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707934976 00000100:00100000:1.0:1784404789.455495:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 312 00000100:00100000:1.0:1784404789.455503:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:2401:x1871083707934464:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404789.455539:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:2401:x1871083707934464:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 37us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404789.455546:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 312 00000100:00100000:1.0:1784404789.455559:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 313 00000100:00100000:1.0:1784404789.455579:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707934976:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404789.455603:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707934976:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404789.455626:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 313 00000100:00080000:1.0:1784404789.455781:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404789.455787:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404789.455797:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707934336 00000100:00100000:1.0:1784404789.455801:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707934336 00000100:00100000:1.0:1784404789.455828:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 384 00000100:00100000:1.0:1784404789.455835:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707934336:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404789.455911:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707934336:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 76us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404789.455918:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 384 00000100:00100000:0.0:1784404789.456611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404789.456637:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707934592 00000100:00100000:0.0:1784404789.456639:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404789.456642:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707934592 00000100:00100000:1.0:1784404789.456675:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707935104 00000100:00100000:1.0:1784404789.456678:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707935104 00000100:00100000:0.0:1784404789.456687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 314 00000100:00100000:1.0:1784404789.456695:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 315 00000100:00100000:0.0:1784404789.456695:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707934592:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404789.456700:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707935104:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404789.456771:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707934848 00000100:00100000:3.0:1784404789.456775:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707934848 00000100:00100000:3.0:1784404789.456804:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:3.0:1784404789.456812:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2401:x1871083707934848:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404789.456911:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2401:x1871083707935104:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 209us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404789.456918:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 315 00000100:00080000:1.0:1784404789.456936:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404789.456941:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404789.460740:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2401:x1871083707934848:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 3923us (4124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404789.460740:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2401:x1871083707934592:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 4028us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404789.460758:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 88 00000100:00100000:0.0:1784404789.460759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 314 00010000:00010000:0.0:1784404789.507180:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404789.637104:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404789.637130:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728940928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404789.637203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404789.637276:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728940928 00000100:00100000:2.0:1784404789.637283:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728940928 00000100:00100000:2.0:1784404789.637328:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784404789.637336:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728940928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404789.637371:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784404789.637417:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728940928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404789.637425:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784404789.637474:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728940928:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1784404790.076640:0:14756:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404790.076653:0:14756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404790.076686:0:14756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784404790.076692:0:14756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784404790.254617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404790.254653:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707935360 00000100:00100000:3.0:1784404790.254662:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707935360 00000100:00100000:3.0:1784404790.254726:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 253 00000100:00100000:3.0:1784404790.254738:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+30:12496:x1871083707935360:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404790.254759:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404790.254783:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79dfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed756a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404790.254934:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79e05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404790.254950:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79e05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404790.254966:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79e05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404790.254977:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784404790.256199:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6e00/0x24b3e2e6dcd79dfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed756a expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404790.256219:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79e05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed756a expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404790.256247:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:3.0:1784404790.256249:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784404790.256253:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6400, rc 0) 00000100:00100000:3.0:1784404790.256325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:12496:x1871083707935360:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1589us (1717us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1784404790.256333:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 253 00000100:00080000:3.0:1784404790.256367:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404790.269384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404790.269464:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707935488 00000100:00100000:2.0:1784404790.269477:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707935488 00000100:00100000:2.0:1784404790.269594:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 254 00000100:00100000:2.0:1784404790.269620:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:12496:x1871083707935488:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1784404790.269687:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269706:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269718:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269754:0:13543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269762:0:13543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269768:0:13543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269775:0:13543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404790.269779:0:13543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269785:0:13543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269796:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:2.0:1784404790.269800:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404790.269804:0:13543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.269810:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f200/0x24b3e2e6dcd79e13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404790.269938:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+32:12496:x1871083707935488:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 320us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404790.269946:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 254 00000100:00100000:3.0:1784404790.432710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404790.438390:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707935616 00000100:00100000:2.0:1784404790.438408:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707935616 00000100:00100000:2.0:1784404790.438490:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:2.0:1784404790.438501:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707935616:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:2.0:1784404790.438518:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404790.438537:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d163921e/0x24b3e2e6dcd79e1a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7571 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784404790.438563:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a5bdb33, atime: 0x6a5bdb32, ctime: 0x6a5bdb33, blocks: 0x8 00010000:00010000:2.0:1784404790.438583:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1784404790.438588:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404790.438597:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d163921e/0x24b3e2e6dcd79e1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7571 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.438616:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d163921e/0x24b3e2e6dcd79e1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7571 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404790.438629:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f200, rc 0) 00000100:00100000:2.0:1784404790.438703:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2403:x1871083707935616:12345-192.168.202.42@tcp:101:cat.0 Request processed in 203us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404790.438709:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 78 00000100:00100000:3.0:1784404790.445181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404790.445255:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707935744 00000100:00100000:0.0:1784404790.445267:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707935744 00002000:00100000:0.0:1784404790.445313:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9dd443d30a80 x1871083707935744/t0(0) o3->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:51/0 lens 488/0 e 0 to 0 dl 1784404801 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784404790.445324:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443d30a80 with x1871083707935744 ext(0->4095) 00002000:00010000:0.0:1784404790.445331:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443d30a80 00000100:00100000:0.0:1784404790.445546:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784404790.445568:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707935744:12345-192.168.202.42@tcp:3:cat.0 00000100:00100000:0.0:1784404790.445764:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+8:2404:x1871083707935744:12345-192.168.202.42@tcp:3:cat.0 Request processed in 197us (595us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1784404790.445772:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00002000:00100000:0.0:1784404790.445779:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9dd443d30a80 x1871083707935744/t0(0) o3->1827e730-172d-4769-8ecb-95f4e65fc8a0@192.168.202.42@tcp:51/0 lens 488/4536 e 0 to 0 dl 1784404801 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784404790.445787:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9dd443d30a80 with x1871083707935744 ext(0->4095) 00002000:00010000:0.0:1784404790.445791:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9dd443d30a80 00010000:00010000:2.0:1784404790.532771:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404791.561641:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784404792.195231:0:9914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410079377015ns, next at 411079373765ns, rc = 0 00000100:00100000:0.0:1784404792.195364:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728941056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404792.195444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.195521:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404792.195528:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728941184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404792.195555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.195703:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728941312:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.195735:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.195766:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728941824:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.195795:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.195814:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728942336:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.195838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.195898:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784404792.195905:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728941440:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.195977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.195997:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728941952:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.196052:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728942464:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.196104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941312 00000100:00100000:0.0:1784404792.196110:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941312 00000100:00100000:0.0:1784404792.196157:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1784404792.196167:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728941312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196216:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728941312:12345-0@lo:400:kworker.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.196224:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1784404792.196257:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941824 00000100:00100000:0.0:1784404792.196261:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941824 00000100:00100000:0.0:1784404792.196283:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784404792.196289:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728941824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196322:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728941824:12345-0@lo:400:kworker.0 Request processed in 33us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.196329:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784404792.196346:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942336 00000100:00100000:0.0:1784404792.196349:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942336 00000100:00100000:0.0:1784404792.196382:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941440 00000100:00100000:0.0:1784404792.196385:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941440 00000100:00100000:0.0:1784404792.196396:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941952 00000100:00100000:0.0:1784404792.196399:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941952 00000100:00100000:0.0:1784404792.196411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942464 00000100:00100000:0.0:1784404792.196413:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942464 00000100:00100000:0.0:1784404792.196430:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784404792.196436:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728942336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196466:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728942336:12345-0@lo:400:kworker.0 Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.196478:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784404792.196491:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784404792.196496:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728941440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196523:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728941440:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.196528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784404792.196539:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1784404792.196544:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728941952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196568:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728941952:12345-0@lo:400:kworker.0 Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.196573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1784404792.196583:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784404792.196589:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728942464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728942464:12345-0@lo:400:kworker.0 Request processed in 23us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.196617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784404792.196640:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728941696:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.196677:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728942208:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.196710:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784404792.196716:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728941568:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.196744:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728942080:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.196783:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728942592:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404792.196822:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941696 00000100:00100000:0.0:1784404792.196825:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941696 00000100:00100000:0.0:1784404792.196845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942080 00000100:00100000:0.0:1784404792.196897:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942080 00000100:00100000:0.0:1784404792.196915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1784404792.196921:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728941696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.196955:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728941696:12345-0@lo:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.196961:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1784404792.196972:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1784404792.196978:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728942080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197003:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728942080:12345-0@lo:400:kworker.0 Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.197008:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00080000:0.0:1784404792.197041:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f75500 x1871083728942080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404792.197056:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728942080:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197067:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728941696:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197106:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728941440:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197115:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728941952:0@lo:400:kworker.0 00010000:00080000:0.0:1784404792.197124:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd577f74380 x1871083728942464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404792.197140:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728942464:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197152:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728941312:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197163:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728941824:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197172:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728942336:0@lo:400:kworker.0 00000100:00080000:0.0:1784404792.197218:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404792.197222:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404792.197241:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942208 00000100:00100000:0.0:1784404792.197244:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942208 00000100:00100000:0.0:1784404792.197270:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942592 00000100:00100000:0.0:1784404792.197273:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942592 00000100:00100000:0.0:1784404792.197291:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784404792.197298:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728942208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197332:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728942208:12345-0@lo:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.197338:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784404792.197349:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784404792.197355:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728942592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197380:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728942592:12345-0@lo:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404792.197386:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1784404792.197399:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404792.197401:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404792.197416:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728942592:0@lo:400:kworker.0 00000100:00100000:0.0:1784404792.197424:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1784404792.197435:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:0.0:1784404792.197460:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd443d18380, transno 4294967308 00000004:00080000:0.0:1784404792.197471:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1784404792.197487:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd443d31880, transno 4294967311 00000100:00100000:0.0:1784404792.197492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728942208:0@lo:400:kworker.0 00000100:00100000:1.0:1784404792.197838:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404792.197888:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728942720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404792.197963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404792.198286:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941056 00000100:00100000:2.0:1784404792.198292:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941056 00000100:00100000:2.0:1784404792.198326:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941184 00000100:00100000:2.0:1784404792.198330:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941184 00000100:00100000:2.0:1784404792.198344:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942720 00000100:00100000:2.0:1784404792.198346:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942720 00000100:00100000:2.0:1784404792.198357:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784404792.198363:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728941056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404792.198384:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784404792.198423:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728941056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (2979us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404792.198429:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784404792.198442:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784404792.198448:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57512a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728941184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404792.198463:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404792.198489:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57512a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728941184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404792.198495:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784404792.199243:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784404792.199254:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728942720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404792.199267:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404792.199303:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728942720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404792.199310:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784404792.199343:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728941568 00000100:00100000:2.0:1784404792.199349:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728941568 00000100:00100000:2.0:1784404792.199389:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784404792.199395:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728941568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404792.199430:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728941568:12345-0@lo:400:kworker.0 Request processed in 35us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404792.199435:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:2.0:1784404792.199473:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404792.199478:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404792.200254:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728942720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404792.200272:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728941184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404792.200286:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728941056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404792.200656:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728941568:0@lo:400:kworker.0 00000100:00100000:1.0:1784404792.201234:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404792.201248:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728942848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404792.201299:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404792.201428:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942848 00000100:00100000:2.0:1784404792.201435:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942848 00000100:00100000:2.0:1784404792.201481:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784404792.201491:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728942848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404792.201509:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784404792.201616:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728942848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404792.201623:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784404792.202142:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728942848:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784404792.580295:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784404793.229098:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:3.0:1784404793.229144:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1784404793.229174:0:6498:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd4435e30c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1784404793.229179:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd54870fc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4435e3780 00000020:00080000:3.0:1784404793.229182:0:6498:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd54870f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd441a52800 00000020:00080000:3.0:1784404793.229205:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1784404793.229266:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404793.229279:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404793.229288:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404793.229294:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404793.229299:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404793.229322:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404793.229339:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9dd443416600) 00010000:00010000:3.0:1784404793.229343:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404793.229348:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404793.229354:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6a00/0x24b3e2e6dcd79d95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784404793.229401:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1784404793.229467:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1784404793.229737:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728942976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784404793.229826:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404793.229933:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728942976 00000100:00100000:1.0:1784404793.229942:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728942976 00000100:00100000:1.0:1784404793.229988:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784404793.229998:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728942976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1784404793.230110:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784404793.230114:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1784404787 -> 1784404787 00002000:00010000:1.0:1784404793.230116:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1784404786 -> 1784404786 00002000:00010000:1.0:1784404793.230119:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1784404787 -> 1784404787 00002000:00010000:1.0:1784404793.230121:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784404793.230157:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083728942976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (331us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784404793.230165:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:1.0:1784404793.230233:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd443d88e00/2, rc 0, transno 4294967325 00000100:00100000:1.0:1784404793.230239:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728942976:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1784404793.230689:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1784404793.230696:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000040:00080000:3.0:1784404793.347555:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1784404793.477093:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404793.477103:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404793.477125:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784404793.477134:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784404793.606977:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404793.731729:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404793.731758:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728943104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404793.731868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404793.731945:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728943104 00000100:00100000:3.0:1784404793.731952:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728943104 00000100:00100000:3.0:1784404793.731999:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784404793.732008:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728943104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404793.732045:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784404793.732093:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728943104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404793.732101:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784404793.732151:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728943104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404794.579945:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404794.579984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404794.580007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404794.580030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404794.580045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404794.580061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404794.580081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404794.580110:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936256 00000100:00100000:1.0:1784404794.580119:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936256 00000100:00100000:1.0:1784404794.580190:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936384 00000100:00100000:1.0:1784404794.580194:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936384 00000100:00100000:1.0:1784404794.580218:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:1.0:1784404794.580229:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707936256:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404794.580305:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707936256:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 78us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404794.580312:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 91 00000100:00100000:1.0:1784404794.580329:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:1.0:1784404794.580335:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707936384:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404794.580360:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2402:x1871083707936384:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404794.580366:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 92 00000100:00100000:1.0:1784404794.580397:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936000 00000100:00100000:1.0:1784404794.580400:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936000 00000100:00100000:1.0:1784404794.580429:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936512 00000100:00100000:1.0:1784404794.580432:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936512 00000100:00100000:1.0:1784404794.580444:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936128 00000100:00100000:1.0:1784404794.580447:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936128 00000100:00100000:1.0:1784404794.580458:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936640 00000100:00100000:1.0:1784404794.580461:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936640 00000100:00100000:1.0:1784404794.580475:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 322 00000100:00100000:1.0:1784404794.580482:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2402:x1871083707936000:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404794.580509:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2402:x1871083707936000:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404794.580528:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 322 00000100:00100000:1.0:1784404794.580542:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 323 00000100:00100000:1.0:1784404794.580549:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707936512:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404794.580572:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707936512:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404794.580578:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 323 00000100:00100000:1.0:1784404794.580590:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 324 00000100:00100000:1.0:1784404794.580596:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707936128:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404794.580619:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2402:x1871083707936128:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404794.580625:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 324 00000100:00100000:1.0:1784404794.580636:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 325 00000100:00100000:1.0:1784404794.580642:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707936640:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404794.581137:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2402:x1871083707936640:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 492us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404794.581152:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 325 00000100:00100000:1.0:1784404794.581174:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707935872 00000100:00100000:1.0:1784404794.581178:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707935872 00000100:00100000:1.0:1784404794.581326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 386 00000100:00100000:1.0:1784404794.581335:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2402:x1871083707935872:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404794.581362:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2402:x1871083707935872:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404794.581368:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 386 00000100:00080000:0.0:1784404794.583793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404794.583802:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784404794.583805:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404794.583807:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784404794.628277:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404794.756171:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728943232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404794.756241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404794.756412:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728943232 00000100:00100000:2.0:1784404794.756420:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728943232 00000100:00100000:2.0:1784404794.756469:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1784404794.756480:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728943232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404794.756514:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784404794.756562:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728943232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404794.756579:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1784404794.756616:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728943232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404795.210500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404795.210785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936768 00000100:00100000:0.0:1784404795.210796:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936768 00000100:00100000:0.0:1784404795.210908:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 255 00000100:00100000:0.0:1784404795.210919:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:12150:x1871083707936768:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784404795.211040:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:12150:x1871083707936768:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 112us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404795.211049:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 255 00000100:00100000:3.0:1784404795.213887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404795.214139:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707936896 00000100:00100000:0.0:1784404795.214150:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707936896 00000100:00100000:0.0:1784404795.214272:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 256 00000100:00100000:0.0:1784404795.214283:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:12150:x1871083707936896:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784404795.214397:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:12150:x1871083707936896:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 115us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404795.214418:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 256 00000100:00100000:3.0:1784404795.218846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404795.219137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707937152 00000100:00100000:0.0:1784404795.219147:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707937152 00000100:00100000:0.0:1784404795.219268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:0.0:1784404795.219280:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:12150:x1871083707937152:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784404795.219591:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:12150:x1871083707937152:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 312us (769us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1784404795.219599:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:3.0:1784404795.431652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404795.431943:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707937280 00000100:00100000:0.0:1784404795.431957:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707937280 00000100:00100000:0.0:1784404795.432034:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 257 00000100:00100000:0.0:1784404795.432044:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:12953:x1871083707937280:12345-192.168.202.42@tcp:101:lsof.0 00010000:00010000:0.0:1784404795.432066:0:13543:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404795.432089:0:13543:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79e21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7578 expref: -99 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404795.432159:0:13543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79e28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404795.432174:0:13543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79e28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404795.432187:0:13543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79e28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784404795.432249:0:13543:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784404795.432253:0:13543:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784404795.432293:0:13543:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79e28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13543 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404795.432316:0:13543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b400/0x24b3e2e6dcd79e21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7578 expref: 7 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404795.432338:0:13543:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79e28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7578 expref: 6 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404795.432346:0:13543:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:0.0:1784404795.432348:0:13543:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404795.432352:0:13543:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151bc00, rc 0) 00000100:00100000:0.0:1784404795.432426:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+6:12953:x1871083707937280:12345-192.168.202.42@tcp:101:lsof.0 Request processed in 382us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404795.432433:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 257 00010000:00010000:0.0:1784404795.651119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404796.678878:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404797.317023:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728943616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404797.317101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404797.317161:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728943360:0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.317205:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728944256:0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.317247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404797.317269:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728944768:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.317274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404797.317302:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728943488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404797.317306:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404797.317326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404797.317327:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784404797.317333:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728943872:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.317340:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728944000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404797.317356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404797.317356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404797.317371:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728944384:0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.317423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404797.317442:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728944896:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.317455:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728944512:0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.317463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404797.317475:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404797.317491:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728945024:0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.317493:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728943616 00000100:00100000:0.0:1784404797.317499:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728943616 00000100:00100000:3.0:1784404797.317512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404797.317594:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728943488 00000100:00100000:2.0:1784404797.317599:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728943488 00000100:00100000:2.0:1784404797.317630:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944000 00000100:00100000:2.0:1784404797.317640:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944000 00000100:00100000:2.0:1784404797.317662:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784404797.317671:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728943488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404797.317708:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784404797.317755:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728943488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.317762:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784404797.317781:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784404797.317787:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728944000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404797.317820:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404797.317916:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728944000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.317923:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784404797.317944:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944256 00000100:00100000:2.0:1784404797.317947:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944256 00000100:00100000:2.0:1784404797.317970:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728943872 00000100:00100000:2.0:1784404797.317973:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728943872 00000100:00100000:2.0:1784404797.317985:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784404797.317990:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728944256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.318025:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728944256:12345-0@lo:400:kworker.0 Request processed in 35us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.318031:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784404797.318043:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784404797.318048:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728943872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.318075:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728943872:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.318080:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784404797.318108:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728945280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404797.318135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404797.318169:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728943872:0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.318181:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728944256:0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.318227:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945280 00000100:00100000:2.0:1784404797.318231:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945280 00000100:00100000:2.0:1784404797.318255:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784404797.318262:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728945280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404797.318273:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784404797.318305:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728945280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.318309:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784404797.318332:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1784404797.318337:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1784404797.318354:0:3646:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9dd443d88e00 x1871083728942976/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1784404809 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404797.318368:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728945280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404797.318405:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728943744:0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.318430:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404797.318499:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784404797.318507:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728943616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404797.318518:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404797.318553:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728943616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404797.318559:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1784404797.318579:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404797.318583:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404797.321060:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728943488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404797.321085:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728944000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404797.321134:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728943360 00000100:00100000:3.0:1784404797.321141:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728943360 00000100:00100000:3.0:1784404797.322316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1784404797.322331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728943360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.322494:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3648:x1871083728943360:12345-0@lo:400:kworker.0 Request processed in 169us (5218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404797.322502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784404797.323116:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728944128:0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.323159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404797.332773:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728944640:0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.332878:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404797.332911:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728945152:0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.332953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404797.333048:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728943360:0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.333113:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945024 00000100:00100000:2.0:1784404797.333120:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945024 00000100:00100000:2.0:1784404797.333279:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944640 00000100:00100000:2.0:1784404797.333283:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944640 00000100:00100000:2.0:1784404797.333298:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945152 00000100:00100000:2.0:1784404797.333301:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945152 00000100:00100000:2.0:1784404797.333316:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784404797.333323:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728945024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.333532:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728945024:12345-0@lo:400:kworker.0 Request processed in 195us (16004us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.333540:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784404797.333573:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784404797.333596:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728944640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.333693:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728944640:12345-0@lo:400:kworker.0 Request processed in 113us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.333700:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784404797.333728:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784404797.333750:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728945152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404797.333826:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728945152:12345-0@lo:400:kworker.0 Request processed in 64us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404797.333833:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784404797.338229:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944768 00000100:00100000:0.0:1784404797.338248:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944768 00000100:00100000:0.0:1784404797.338313:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944384 00000100:00100000:0.0:1784404797.338317:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944384 00000100:00100000:0.0:1784404797.338334:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944896 00000100:00100000:0.0:1784404797.338337:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944896 00000100:00100000:0.0:1784404797.338352:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944512 00000100:00100000:0.0:1784404797.338355:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944512 00000100:00100000:0.0:1784404797.338367:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728943744 00000100:00100000:0.0:1784404797.338369:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728943744 00000100:00100000:0.0:1784404797.338402:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728944128 00000100:00100000:0.0:1784404797.338405:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728944128 00000100:00100000:0.0:1784404797.338423:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1784404797.338433:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728944768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.338528:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728944768:12345-0@lo:400:kworker.0 Request processed in 96us (21219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404797.338552:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1784404797.338571:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1784404797.338577:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728944384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.338605:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728944384:12345-0@lo:400:kworker.0 Request processed in 29us (21182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404797.338610:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1784404797.338774:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1784404797.338783:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728944896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.338832:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728944896:12345-0@lo:400:kworker.0 Request processed in 52us (21368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404797.338838:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1784404797.338865:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784404797.338871:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1784404797.338871:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728944512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.338880:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728943744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404797.338901:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728944512:12345-0@lo:400:kworker.0 Request processed in 31us (21425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404797.338907:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1784404797.338918:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784404797.338920:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728943744:12345-0@lo:400:kworker.0 Request processed in 43us (20490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404797.338923:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728944128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.338926:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1784404797.338948:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728944128:12345-0@lo:400:kworker.0 Request processed in 25us (15791us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404797.338953:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:0.0:1784404797.338976:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404797.338981:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404797.339001:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728944384:0@lo:400:kworker.0 00010000:00080000:3.0:1784404797.339016:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d86680 x1871083728944896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404797.339025:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728944896:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.339034:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728944768:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.339052:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728943616:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1784404797.339101:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d87480 x1871083728944512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404797.339110:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728944512:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.339122:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728945024:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.339159:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728943744:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.339746:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728944128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.339765:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728944640:0@lo:400:kworker.0 00000100:00100000:3.0:1784404797.339778:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728945152:0@lo:400:kworker.0 00010000:00010000:0.0:1784404797.699167:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404798.723732:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404798.851377:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728945408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404798.851467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404798.851610:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945408 00000100:00100000:3.0:1784404798.851621:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945408 00000100:00100000:3.0:1784404798.851680:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784404798.851690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd545b86450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728945408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404798.851733:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784404798.851801:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd545b86450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728945408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404798.851810:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784404798.852294:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728945408:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1784404798.854353:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1784404798.854373:0:6498:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1784404798.854429:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1784404798.854443:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1784404798.855303:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000100:00100000:1.0:1784404799.700839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404799.700917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404799.700946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404799.700969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404799.700988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404799.701006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404799.701030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404799.701058:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707937920 00000100:00100000:1.0:1784404799.701068:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707937920 00000100:00100000:1.0:1784404799.701125:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707937792 00000100:00100000:1.0:1784404799.701128:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707937792 00000100:00100000:1.0:1784404799.701153:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:1.0:1784404799.701164:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707937920:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404799.701242:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2403:x1871083707937920:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404799.701250:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 96 00000100:00100000:1.0:1784404799.701267:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:1.0:1784404799.701274:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707937792:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404799.701311:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707937792:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404799.701317:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 97 00000100:00100000:1.0:1784404799.701336:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707937664 00000100:00100000:1.0:1784404799.701340:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707937664 00000100:00100000:1.0:1784404799.701366:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707938176 00000100:00100000:1.0:1784404799.701369:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707938176 00000100:00100000:1.0:1784404799.701380:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707937536 00000100:00100000:1.0:1784404799.701382:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707937536 00000100:00100000:1.0:1784404799.701393:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707938048 00000100:00100000:1.0:1784404799.701395:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707938048 00000100:00100000:1.0:1784404799.701406:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 332 00000100:00100000:1.0:1784404799.701411:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707937664:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404799.701439:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2403:x1871083707937664:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404799.701445:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 332 00000100:00100000:1.0:1784404799.701457:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 333 00000100:00100000:1.0:1784404799.701463:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707938176:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404799.701487:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707938176:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404799.701493:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 333 00000100:00100000:1.0:1784404799.701504:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 334 00000100:00100000:1.0:1784404799.701510:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2403:x1871083707937536:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404799.701690:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707937408 00000100:00100000:3.0:1784404799.701695:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707937408 00000100:00100000:3.0:1784404799.701727:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 388 00000100:00100000:3.0:1784404799.701734:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707937408:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404799.701762:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2403:x1871083707937408:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404799.701768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 388 00000100:00100000:3.0:1784404799.701811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 335 00000100:00100000:3.0:1784404799.701819:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707938048:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404799.701844:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707938048:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404799.701865:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 335 00000100:00100000:1.0:1784404799.703708:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:2403:x1871083707937536:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 2183us (2704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404799.703735:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 334 00000100:00080000:1.0:1784404799.703793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404799.703801:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404799.703804:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404799.703807:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784404799.748024:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784404799.787292:0:14955:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:59:58 (1784404798) 00000100:00100000:1.0:1784404799.887571:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728945536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404799.887655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404799.887802:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945536 00000100:00100000:0.0:1784404799.887813:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945536 00000100:00100000:0.0:1784404799.887886:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784404799.887896:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728945536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404799.887933:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784404799.896577:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728945536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8670us (8909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404799.896594:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1784404799.896921:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728945536:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784404800.774346:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404801.795379:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404802.435170:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728945664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404802.435247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404802.435786:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945664 00000100:00100000:2.0:1784404802.435803:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945664 00000100:00100000:2.0:1784404802.435877:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784404802.435890:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728945664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404802.435921:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784404802.435974:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728945664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404802.435982:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784404802.436010:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728946176:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.436042:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404802.436062:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728946688:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.436086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404802.436102:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728947200:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.436135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404802.436184:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728945664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404802.436202:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784404802.436207:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728946048:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.436238:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404802.436259:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728946560:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.436285:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404802.436301:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728947072:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.436323:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404802.436529:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946176 00000100:00100000:0.0:1784404802.436535:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946176 00000100:00100000:0.0:1784404802.436574:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946688 00000100:00100000:0.0:1784404802.436577:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946688 00000100:00100000:0.0:1784404802.436607:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947200 00000100:00100000:0.0:1784404802.436611:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947200 00000100:00100000:0.0:1784404802.436628:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1784404802.436635:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728946176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404802.436681:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728946176:12345-0@lo:400:kworker.0 Request processed in 45us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404802.436688:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1784404802.436703:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784404802.436710:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728946688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404802.436736:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728946688:12345-0@lo:400:kworker.0 Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404802.436742:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784404802.436778:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1784404802.436785:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728947200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404802.436815:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083728947200:12345-0@lo:400:kworker.0 Request processed in 31us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404802.436821:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1784404802.436839:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946560 00000100:00100000:0.0:1784404802.436842:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946560 00000100:00100000:0.0:1784404802.436893:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784404802.436900:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728946560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404802.436932:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728946560:12345-0@lo:400:kworker.0 Request processed in 32us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404802.436937:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1784404802.437119:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404802.437124:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404802.437138:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947072 00000100:00100000:1.0:1784404802.437141:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947072 00000100:00100000:1.0:1784404802.437175:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784404802.437184:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728947072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404802.437217:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728947072:12345-0@lo:400:kworker.0 Request processed in 36us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404802.437222:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1784404802.437240:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404802.437330:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728947584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404802.437363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404802.437445:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947584 00000100:00100000:1.0:1784404802.437450:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947584 00000100:00100000:1.0:1784404802.437491:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784404802.437497:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728947584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784404802.437511:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784404802.437545:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728947584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404802.437551:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784404802.437603:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1784404802.437609:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd443d88e00, transno 4294967325 00000100:00100000:1.0:1784404802.437625:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728947584:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784404802.437870:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404802.438807:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728946560:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.438824:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728947072:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.438835:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728946176:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.438890:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728946688:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.438901:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083728947200:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.439119:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728945792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404802.439182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439220:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728946304:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.439246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439279:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728946816:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.439304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439328:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728947328:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.439349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439377:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784404802.439384:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728945920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404802.439406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439433:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728946432:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.439455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439472:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728946944:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.439494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728947456:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.439532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404802.439567:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946816 00000100:00100000:3.0:1784404802.439573:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946816 00000100:00100000:0.0:1784404802.439743:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945792 00000100:00100000:0.0:1784404802.439748:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945792 00000100:00100000:1.0:1784404802.439819:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946304 00000100:00100000:1.0:1784404802.439824:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946304 00000100:00100000:1.0:1784404802.439904:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784404802.439915:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728946304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404802.439983:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728946304:12345-0@lo:400:kworker.0 Request processed in 70us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404802.439990:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784404802.440015:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946944 00000100:00100000:1.0:1784404802.440017:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946944 00000100:00100000:1.0:1784404802.440042:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947456 00000100:00100000:1.0:1784404802.440045:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947456 00000100:00100000:1.0:1784404802.440064:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784404802.440071:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1871083728946944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404802.440100:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1871083728946944:12345-0@lo:400:kworker.0 Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404802.440121:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784404802.440133:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784404802.440139:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728947456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404802.440168:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728947456:12345-0@lo:400:kworker.0 Request processed in 30us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404802.440175:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784404802.440224:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946048 00000100:00100000:1.0:1784404802.440228:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946048 00000100:00100000:1.0:1784404802.440253:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1784404802.440273:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728946048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404802.440310:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728946048:12345-0@lo:400:kworker.0 Request processed in 39us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404802.440317:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1784404802.440346:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947328 00000100:00100000:1.0:1784404802.440350:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947328 00000100:00100000:2.0:1784404802.440441:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728946432 00000100:00100000:2.0:1784404802.440446:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728946432 00000100:00100000:2.0:1784404802.440476:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784404802.440483:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728946432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.440519:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728946432:12345-0@lo:400:kworker.0 Request processed in 37us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404802.440525:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784404802.440572:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728946048:0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.440821:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784404802.440829:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728946816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404802.440880:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728946816:12345-0@lo:400:kworker.0 Request processed in 52us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404802.440886:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1784404802.442913:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728946432:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.442933:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728946944:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.442945:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728947456:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.442957:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728946304:0@lo:400:kworker.0 00010000:00080000:2.0:1784404802.442972:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443db5f80 x1871083728946816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404802.442983:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728946816:0@lo:400:kworker.0 00000100:00100000:2.0:1784404802.443036:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728945920 00000100:00100000:2.0:1784404802.443043:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728945920 00000100:00100000:2.0:1784404802.443095:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784404802.443157:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728945920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404802.443191:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404802.443286:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728945920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (3877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404802.443294:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784404802.443337:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728945920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404802.446901:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784404802.446918:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728945792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784404802.446945:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404802.447040:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728945792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (7857us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404802.447047:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784404802.447126:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728945792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404802.451414:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1784404802.451439:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728947328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404802.451539:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728947328:12345-0@lo:400:kworker.0 Request processed in 105us (12188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404802.451548:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00080000:0.0:1784404802.452739:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d8a300 x1871083728947328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404802.452789:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728947328:0@lo:400:kworker.0 00000100:00080000:3.0:1784404802.457732:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784404802.457746:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784404802.819153:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784404803.587963:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1784404803.718290:0:13786:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784404803.718302:0:13786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784404803.718413:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1784404803.718419:0:13786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784404803.845898:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404803.973809:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728947712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404803.973921:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404803.974088:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947712 00000100:00100000:0.0:1784404803.974097:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947712 00000100:00100000:0.0:1784404803.974168:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784404803.974178:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728947712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404803.974212:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784404803.974266:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728947712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404803.974273:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1784404803.974812:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728947712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404804.365836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404804.366083:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707938432 00000100:00100000:0.0:1784404804.366094:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707938432 00000100:00100000:0.0:1784404804.366215:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:0.0:1784404804.366230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+18:13177:x1871083707938432:12345-192.168.202.42@tcp:35:umount.0 00000100:00080000:3.0:1784404804.366659:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404804.366843:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:13177:x1871083707938432:12345-192.168.202.42@tcp:35:umount.0 Request processed in 615us (1104us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1784404804.366874:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:3.0:1784404804.369618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404804.369753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707938688 00000100:00100000:1.0:1784404804.369764:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707938688 00000100:00100000:1.0:1784404804.369831:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1784404804.369844:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+19:13177:x1871083707938688:12345-192.168.202.42@tcp:35:umount.0 00000100:00100000:1.0:1784404804.370214:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:13177:x1871083707938688:12345-192.168.202.42@tcp:35:umount.0 Request processed in 372us (606us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1784404804.370222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1784404804.372898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404804.376549:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707938944 00000100:00100000:0.0:1784404804.376567:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707938944 00000100:00100000:0.0:1784404804.376727:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:0.0:1784404804.376749:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54828b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+20:13177:x1871083707938944:12345-192.168.202.42@tcp:35:umount.0 00000100:00100000:0.0:1784404804.377104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54828b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:13177:x1871083707938944:12345-192.168.202.42@tcp:35:umount.0 Request processed in 366us (4217us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1784404804.377126:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:2.0:1784404804.383933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404804.385279:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707939200 00000100:00100000:3.0:1784404804.385294:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707939200 00000100:00100000:3.0:1784404804.385373:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:3.0:1784404804.385383:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:13177:x1871083707939200:12345-192.168.202.42@tcp:35:umount.0 00000100:00100000:3.0:1784404804.387402:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:13177:x1871083707939200:12345-192.168.202.42@tcp:35:umount.0 Request processed in 2010us (3469us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784404804.387416:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:0.0:1784404804.397210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404804.397246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404804.397270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707939456 00000100:00100000:2.0:1784404804.397281:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707939456 00000100:00100000:2.0:1784404804.397346:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707939328 00000100:00100000:2.0:1784404804.397350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707939328 00000100:00100000:1.0:1784404804.397364:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1784404804.397379:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+14:2401:x1871083707939456:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404804.397397:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404804.397434:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390200/0x24b3e2e6dcd78d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed708c expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404804.397452:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404804.397524:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707939456:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 149us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404804.398133:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1784404804.398145:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+13:2401:x1871083707939328:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404804.398156:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404804.398169:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548000/0x24b3e2e6dcd78dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70cb expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404804.398180:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404804.398208:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:2401:x1871083707939328:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 67us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404804.398216:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:1.0:1784404804.398278:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1784404804.405136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404804.405202:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707939584 00000100:00100000:0.0:1784404804.405209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404804.405214:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707939584 00000100:00100000:3.0:1784404804.405554:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:3.0:1784404804.405568:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:2404:x1871083707939584:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404804.405588:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404804.405613:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd79052 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71a4 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404804.405634:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404804.405717:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2404:x1871083707939584:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 152us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404804.405725:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1784404804.412872:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707939968 00000100:00100000:1.0:1784404804.412893:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707939968 00000100:00100000:1.0:1784404804.413012:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00100000:1.0:1784404804.413035:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+7:2400:x1871083707939968:12345-192.168.202.42@tcp:9:umount.0 00000020:00000080:1.0:1784404804.413068:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79393 00000020:00010000:1.0:1784404804.413077:0:8434:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd5462d7800: total 0 00000100:00080000:1.0:1784404804.413083:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9dd5462d5800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1784404804.413128:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd5462d7800: total 0 00010000:00010000:0.0:1784404804.413196:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd5462d7800, canceled 0 locks, left on hash table 2. 00000001:00000004:1.0:1784404804.413243:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:0.0:1784404804.413256:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d163921e/0x24b3e2e6dcd79e1a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7571 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.413297:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d82b05/0x24b3e2e6dcd7974b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed738e expref: 5 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.413315:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd5462d7800, canceled 2 locks, left on hash table 0. 00000100:00100000:1.0:1784404804.413420:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1827e730-172d-4769-8ecb-95f4e65fc8a0+3:2400:x1871083707939968:12345-192.168.202.42@tcp:9:umount.0 Request processed in 398us (8212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404804.413428:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 80 00000100:00080000:3.0:1784404804.413825:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784404804.415355:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404804.415368:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404804.415371:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404804.417549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404804.417622:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707940096 00000100:00100000:1.0:1784404804.417633:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707940096 00000100:00100000:1.0:1784404804.417718:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:1.0:1784404804.417729:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2400:x1871083707940096:12345-192.168.202.42@tcp:9:umount.0 00000020:00000080:1.0:1784404804.417773:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7911d 00000100:00080000:1.0:1784404804.417782:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9dd443cf2800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784404804.417826:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784404804.417836:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1784404804.418060:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+2:2400:x1871083707940096:12345-192.168.202.42@tcp:9:umount.0 Request processed in 333us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404804.418086:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00080000:3.0:1784404804.418201:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404804.438640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404804.443273:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707941120 00000100:00100000:3.0:1784404804.443289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707941120 00000100:00100000:3.0:1784404804.443377:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 258 00000100:00100000:3.0:1784404804.443406:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+22:2400:x1871083707941120:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:3.0:1784404804.443458:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d50 00000020:00010000:3.0:1784404804.443481:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd443585800: total 0 00000100:00080000:3.0:1784404804.443486:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9dd443580000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784404804.443521:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1784404804.443710:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1827e730-172d-4769-8ecb-95f4e65fc8a0+21:2400:x1871083707941120:12345-192.168.202.42@tcp:39:umount.0 Request processed in 297us (5069us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1784404804.443719:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 258 00000020:00010000:0.0:1784404804.443992:0:10394:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd443585800: total 0 00010000:00010000:0.0:1784404804.444054:0:10394:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd443585800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784404804.444138:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404804.444143:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784404804.444153:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7c00/0x24b3e2e6dcd797d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73b1 expref: 20 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444185:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd443413d00) 00010000:00010000:0.0:1784404804.444197:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404804.444203:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391000/0x24b3e2e6dcd7907c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71b2 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444228:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:0.0:1784404804.444231:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404804.444235:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd79ddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed755c expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444259:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404804.444261:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784404804.444264:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c7800/0x24b3e2e6dcd7962c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7341 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444275:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:0.0:1784404804.444278:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404804.444281:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd797b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed73aa expref: 16 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444294:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:0.0:1784404804.444296:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784404804.444300:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd4425c6400/0x24b3e2e6dcd79e05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed756a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444312:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404804.444314:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784404804.444317:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd443549c00/0x24b3e2e6dcd790f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71ce expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444343:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404804.444346:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784404804.444350:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fc00/0x24b3e2e6dcd7970c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7379 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444361:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9dd54955f000) 00010000:00010000:0.0:1784404804.444363:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404804.444366:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd79abd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed748a expref: 12 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444382:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:0.0:1784404804.444384:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784404804.444388:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd793ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed72a7 expref: 11 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444403:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd443413800) 00010000:00010000:0.0:1784404804.444405:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784404804.444409:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd541391600/0x24b3e2e6dcd79098 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed71b9 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444423:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9dd573869700) 00010000:00010000:0.0:1784404804.444425:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784404804.444430:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759a00/0x24b3e2e6dcd79cfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7524 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444443:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9dd573869600) 00010000:00010000:0.0:1784404804.444445:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784404804.444455:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd79736 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7387 expref: 8 pid: 9527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404804.444469:0:10394:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd443585800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1784404804.444486:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404804.444488:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404804.444490:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404804.473481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404804.473585:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707941248 00000100:00100000:2.0:1784404804.473596:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707941248 00000100:00100000:2.0:1784404804.473671:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 259 00000100:00100000:2.0:1784404804.473683:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+5:2400:x1871083707941248:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:2.0:1784404804.473736:0:13543:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d57 00000100:00080000:2.0:1784404804.473791:0:13543:0:(import.c:65:import_set_state_nolock()) ffff9dd443587800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404804.473824:0:13543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784404804.474097:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1827e730-172d-4769-8ecb-95f4e65fc8a0+3:2400:x1871083707941248:12345-192.168.202.42@tcp:39:umount.0 Request processed in 415us (628us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784404804.474104:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 259 00010000:00010000:0.0:1784404804.474487:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784404804.474814:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404804.816984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404804.817048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404804.817165:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707941376 00000100:00100000:0.0:1784404804.817177:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707941376 00000100:00100000:0.0:1784404804.817260:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707941504 00000100:00080000:1.0:1784404804.817263:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404804.817265:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707941504 00000100:00100000:0.0:1784404804.817322:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 342 00000100:00100000:2.0:1784404804.817331:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 343 00000100:00100000:0.0:1784404804.817336:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707941376:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404804.817349:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707941504:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:1.0:1784404804.817431:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404804.817507:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2403:x1871083707941504:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 163us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404804.817515:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 343 00000100:00100000:0.0:1784404804.822128:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2403:x1871083707941376:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 4784us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404804.822206:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 342 00010000:00010000:0.0:1784404804.868057:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404804.996977:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404804.999188:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728947840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404804.999268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404804.999347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947840 00000100:00100000:1.0:1784404804.999356:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947840 00000100:00100000:1.0:1784404804.999408:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784404804.999419:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728947840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404804.999456:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1784404804.999524:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728947840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404804.999532:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784404804.999671:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728947840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784404805.892991:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404806.915255:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404807.118653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404807.118696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404807.118735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404807.118805:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707941760 00000100:00100000:2.0:1784404807.118816:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707941760 00000100:00100000:2.0:1784404807.118901:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707941632 00000100:00100000:2.0:1784404807.118904:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707941632 00000100:00100000:2.0:1784404807.118914:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707941888 00000100:00100000:2.0:1784404807.118916:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707941888 00000100:00100000:2.0:1784404807.118930:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1784404807.118938:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb7a08a7-c908-4c30-ba67-617d22aac8ae+12:2401:x1871083707941760:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404807.118953:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404807.118992:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390e00/0x24b3e2e6dcd78e5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7111 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404807.119009:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404807.119056:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb7a08a7-c908-4c30-ba67-617d22aac8ae+11:2401:x1871083707941760:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 119us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404807.119074:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1784404807.119090:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:2.0:1784404807.119095:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb7a08a7-c908-4c30-ba67-617d22aac8ae+10:2401:x1871083707941632:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404807.119103:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404807.119111:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390000/0x24b3e2e6dcd78e53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70e0 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404807.119120:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404807.119134:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb7a08a7-c908-4c30-ba67-617d22aac8ae+9:2401:x1871083707941632:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 39us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404807.119140:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:2.0:1784404807.119172:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1784404807.119177:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb7a08a7-c908-4c30-ba67-617d22aac8ae+8:2401:x1871083707941888:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404807.119182:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404807.119189:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c7600/0x24b3e2e6dcd7904b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed719d expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404807.119198:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404807.119209:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb7a08a7-c908-4c30-ba67-617d22aac8ae+7:2401:x1871083707941888:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404807.119214:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:1.0:1784404807.138620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404807.138759:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707942144 00000100:00100000:2.0:1784404807.138770:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707942144 00000100:00100000:2.0:1784404807.138894:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 260 00000100:00100000:2.0:1784404807.138906:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+6:2400:x1871083707942144:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:2.0:1784404807.138962:0:13543:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78e68 00000020:00010000:2.0:1784404807.138970:0:13543:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd574f21800: total 0 00000100:00080000:2.0:1784404807.138974:0:13543:0:(import.c:65:import_set_state_nolock()) ffff9dd574f27800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404807.138995:0:13543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1784404807.139163:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2400:x1871083707942144:12345-192.168.202.42@tcp:39:umount.0 Request processed in 259us (555us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1784404807.139171:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 260 00000020:00010000:0.0:1784404807.139364:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd574f21800: total 0 00010000:00010000:0.0:1784404807.139369:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404807.139423:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd574f21800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784404807.139461:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd573869300) 00010000:00010000:0.0:1784404807.139465:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784404807.139474:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd79e28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7578 expref: 4 pid: 13543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404807.139509:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd574f21800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784404807.139522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404807.139525:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404807.139526:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404807.139756:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404807.167342:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404807.167442:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707942272 00000100:00100000:1.0:1784404807.167453:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707942272 00000100:00100000:1.0:1784404807.167522:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 261 00000100:00100000:1.0:1784404807.167532:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+5:2400:x1871083707942272:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:1.0:1784404807.167616:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78e6f 00000100:00080000:1.0:1784404807.167626:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9dd443686000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784404807.167648:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1784404807.167824:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:699a5e6e-e921-4091-819a-62d5132b8ddf+3:2400:x1871083707942272:12345-192.168.202.42@tcp:39:umount.0 Request processed in 293us (489us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784404807.167832:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 261 00010000:00010000:0.0:1784404807.168181:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784404807.168262:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404807.227681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404807.228098:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707942528 00000100:00100000:3.0:1784404807.228107:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707942528 00000100:00100000:3.0:1784404807.228177:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 390 00000100:00100000:3.0:1784404807.228189:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+7:2400:x1871083707942528:12345-192.168.202.42@tcp:251:umount.0 00000020:00000080:3.0:1784404807.228235:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d2d 00000020:00010000:3.0:1784404807.228242:0:6513:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd443582800: total 0 00000100:00080000:3.0:1784404807.228246:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784404807.228334:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb7a08a7-c908-4c30-ba67-617d22aac8ae+3:2400:x1871083707942528:12345-192.168.202.42@tcp:251:umount.0 Request processed in 147us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.228341:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 390 00000020:00010000:0.0:1784404807.230075:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd443582800: total 0 00010000:00010000:0.0:1784404807.230160:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd443582800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784404807.230199:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd78e06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed70d2 expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404807.230231:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd443582800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1784404807.230242:0:6508:0:(genops.c:885:class_export_put()) final put ffff9dd443582800/fb7a08a7-c908-4c30-ba67-617d22aac8ae 00010000:00010000:0.0:1784404807.230263:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404807.230265:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404807.230267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784404807.231494:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443582800/fb7a08a7-c908-4c30-ba67-617d22aac8ae for MGS 00000020:00000080:3.0:1784404807.231555:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443583000 for MGS 00000100:00100000:0.0:1784404807.555020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404807.555024:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728948096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404807.555042:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728947968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404807.555140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404807.555447:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728947968 00000100:00100000:3.0:1784404807.555456:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728947968 00000100:00100000:3.0:1784404807.555512:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784404807.555523:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728947968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404807.555555:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404807.555623:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728947968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.555631:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1784404807.555659:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404807.555770:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728948224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404807.555801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404807.555819:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728948736:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.555838:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404807.555873:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728949248:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.555898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404807.555917:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728949760:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.555935:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404807.555954:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784404807.555959:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728948608:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.555980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404807.555994:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728949120:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.556012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404807.556024:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728949632:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.556040:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404807.556062:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948224 00000100:00100000:2.0:1784404807.556065:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948224 00000100:00100000:2.0:1784404807.556102:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784404807.556109:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728948224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404807.556127:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784404807.556159:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728948224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404807.556165:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784404807.556183:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728949248 00000100:00100000:2.0:1784404807.556186:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728949248 00000100:00100000:2.0:1784404807.556209:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728949760 00000100:00100000:2.0:1784404807.556212:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728949760 00000100:00100000:2.0:1784404807.556223:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728949632 00000100:00100000:2.0:1784404807.556225:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728949632 00000100:00100000:2.0:1784404807.556238:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784404807.556244:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728949248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.556612:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948736 00000100:00100000:0.0:1784404807.556616:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948736 00000100:00100000:0.0:1784404807.556649:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728949120 00000100:00100000:0.0:1784404807.556652:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728949120 00000100:00100000:0.0:1784404807.556678:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784404807.556686:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728948736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.556743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728948736:12345-0@lo:400:kworker.0 Request processed in 58us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404807.556749:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784404807.556771:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1784404807.556778:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728949120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.556811:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728949120:12345-0@lo:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404807.556816:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1784404807.556878:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728948352:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.556911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404807.556939:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728948864:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.556967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404807.556988:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728949376:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.557013:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404807.557034:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728949888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404807.557057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404807.557094:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728947968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404807.557114:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784404807.557121:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728948480:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.557157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404807.557172:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728948992:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.557192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404807.557204:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728949504:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.557223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404807.557257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948352 00000100:00100000:0.0:1784404807.557260:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948352 00000100:00100000:0.0:1784404807.557285:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1784404807.557291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728948352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.557327:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728948352:12345-0@lo:400:kworker.0 Request processed in 35us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404807.557335:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1784404807.557362:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948608 00000100:00100000:0.0:1784404807.557365:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948608 00000100:00100000:0.0:1784404807.557401:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948864 00000100:00100000:0.0:1784404807.557404:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948864 00000100:00100000:0.0:1784404807.557417:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784404807.557423:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728948608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.557452:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728948608:12345-0@lo:400:kworker.0 Request processed in 30us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404807.557457:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784404807.557467:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784404807.557473:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728948864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404807.558054:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784404807.558066:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728949760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404807.558109:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728949760:12345-0@lo:400:kworker.0 Request processed in 46us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.558116:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784404807.558134:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784404807.558140:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728949632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404807.558169:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728949632:12345-0@lo:400:kworker.0 Request processed in 29us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.558174:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784404807.558193:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728949376 00000100:00100000:3.0:1784404807.558197:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728949376 00000100:00100000:3.0:1784404807.558221:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948480 00000100:00100000:3.0:1784404807.558224:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948480 00000100:00100000:3.0:1784404807.558235:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948992 00000100:00100000:3.0:1784404807.558238:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948992 00000100:00100000:3.0:1784404807.558250:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728949504 00000100:00100000:3.0:1784404807.558253:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728949504 00000100:00100000:3.0:1784404807.558269:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1784404807.558275:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728949376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.558327:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728948864:12345-0@lo:400:kworker.0 Request processed in 854us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.558334:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083728949376:12345-0@lo:400:kworker.0 Request processed in 57us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404807.558339:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784404807.558347:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1784404807.558367:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1784404807.558373:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728948480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.558388:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1784404807.558400:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728948992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404807.558406:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728948480:12345-0@lo:400:kworker.0 Request processed in 31us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.558414:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1784404807.558430:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1784404807.558438:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728949504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.558444:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728948992:12345-0@lo:400:kworker.0 Request processed in 46us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404807.558452:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784404807.558477:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083728949504:12345-0@lo:400:kworker.0 Request processed in 39us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.558483:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:3.0:1784404807.558530:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404807.558534:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404807.558537:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784404807.558539:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784404807.558550:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728949888 00000100:00100000:3.0:1784404807.558554:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728949888 00000100:00100000:3.0:1784404807.558577:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784404807.558582:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728949888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404807.558594:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404807.558621:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577f74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728949888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.558627:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784404807.558662:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728948608:0@lo:400:kworker.0 00010000:00080000:3.0:1784404807.558686:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443db6d80 x1871083728949120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404807.558698:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728949120:0@lo:400:kworker.0 00000100:00100000:3.0:1784404807.558708:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728949632:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.559066:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728949248:12345-0@lo:400:kworker.0 Request processed in 2820us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404807.559074:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784404807.559550:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728948224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404807.562130:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728948480:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.562153:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728948992:0@lo:400:kworker.0 00010000:00080000:0.0:1784404807.562168:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd570592680 x1871083728949504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404807.562199:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728949504:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.562217:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728948352:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.562230:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728948864:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.562242:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728949376:0@lo:400:kworker.0 00000100:00100000:0.0:1784404807.562267:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728949888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404807.562268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404807.562493:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728948096 00000100:00100000:3.0:1784404807.562504:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728948096 00000100:00100000:3.0:1784404807.562552:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784404807.562561:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728948096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784404807.562583:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784404807.562649:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728948096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404807.562656:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784404807.562990:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728948096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404807.566700:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728948736:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.566742:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728949248:0@lo:400:kworker.0 00000100:00100000:2.0:1784404807.566754:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728949760:0@lo:400:kworker.0 00010000:00010000:0.0:1784404807.939519:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784404808.085752:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00080000:3.0:1784404808.085768:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1784404808.085774:0:6498:0:(genops.c:885:class_export_put()) final put ffff9dd574f21800/699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00100000:3.0:1784404808.085800:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000001:00080000:3.0:1784404808.085807:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1784404808.085818:0:6498:0:(genops.c:885:class_export_put()) final put ffff9dd443585800/1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:0.0:1784404808.085937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574f21800/699a5e6e-e921-4091-819a-62d5132b8ddf for lustre-MDT0000 00000020:00000080:0.0:1784404808.085992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443585800/1827e730-172d-4769-8ecb-95f4e65fc8a0 for lustre-MDT0000 00000020:00000080:0.0:1784404808.086025:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574f27800 for lustre-MDT0000 00000020:00000080:0.0:1784404808.086031:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443580000 for lustre-MDT0000 00010000:00010000:1.0:1784404808.964428:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784404809.056299:0:15151:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784404809.083649:0:15151:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784404809.083715:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.083732:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.083760:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.083767:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.083796:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784404809.083802:0:15151:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784404809.083833:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404809.083838:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784404809.083843:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784404809.083892:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd57394b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784404809.083923:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728950016:0@lo:39:umount.0 00000100:00100000:2.0:1784404809.083983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404809.084876:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404809.084886:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.084895:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821daa00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404809.084899:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.084908:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404809.084915:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404809.084921:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404809.084923:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784404809.084926:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784404809.084960:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.084966:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404809.084988:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.084995:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd78dd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78ddc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.085019:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404809.085021:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404809.085023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404809.085047:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950016 00000100:00100000:1.0:1784404809.085053:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950016 00000100:00100000:1.0:1784404809.085107:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784404809.085117:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1871083728950016:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784404809.085144:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78944 00000100:00080000:1.0:1784404809.085151:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9dd573a39800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784404809.085226:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1871083728950016:12345-0@lo:39:umount.0 Request processed in 110us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404809.085233:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1784404809.085242:0:6520:0:(genops.c:885:class_export_put()) final put ffff9dd573a3b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784404809.085265:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573a3b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784404809.085304:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd573a39800 for lustre-MDT0000 00000100:00080000:1.0:1784404809.085337:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57394b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784404809.085346:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728950016:0@lo:39:umount.0 00000100:00100000:1.0:1784404809.085382:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404809.085408:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728950144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404809.085824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404809.085892:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950144 00000100:00100000:1.0:1784404809.085897:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950144 00000100:00100000:1.0:1784404809.085932:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404809.085939:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3646:x1871083728950144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404809.085949:0:10336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404809.085973:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821dba00/0x24b3e2e6dcd78ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dd5 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.085987:0:10336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404809.086016:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:3646:x1871083728950144:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404809.086023:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404809.086051:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728950144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404809.086075:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784404809.087329:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404809.087335:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784404809.087341:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784404809.090671:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.090693:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.090707:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.090714:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.090765:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784404809.091081:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404809.091088:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.091096:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404809.091099:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.091107:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404809.091114:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404809.091120:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404809.091123:0:10394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1784404809.091147:0:10394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.091153:0:10394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404809.091162:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.091176:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd78de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.091189:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404809.091191:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404809.091193:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404809.091211:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728950272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404809.091279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784404809.092554:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.092572:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.092579:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.092587:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404809.092888:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728950400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404809.092957:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784404809.093027:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404809.093037:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093044:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093050:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093056:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093085:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784404809.093091:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093098:0:15151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093104:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093110:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404809.093119:0:15151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1784404809.093124:0:15151:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784404809.093129:0:15151:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784404809.093165:0:15151:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784404809.093170:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1784404809.093175:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404809.093181:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1784404809.093187:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd442731000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404809.093193:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd574d7e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404809.093197:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd574c04800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404809.093202:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd57c5d4000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1784404809.093208:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9dd545b93380) has exports, disconnecting them 00000020:00080000:2.0:1784404809.093213:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd442731000), last request at 1784404807 00000020:00000080:2.0:1784404809.093220:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78c54 00000100:00080000:2.0:1784404809.093244:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd442733800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784404809.093291:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd442731000): rc 0 00000020:00000080:2.0:1784404809.093294:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd442731000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784404809.093306:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd574d7e800), last request at 1784404807 00000020:00000080:2.0:1784404809.093309:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78b2e 00000100:00080000:2.0:1784404809.093314:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd442284000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784404809.093326:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442731000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784404809.093373:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442733800 for lustre-MDT0000 00000020:00080000:2.0:1784404809.093389:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd574d7e800): rc 0 00000020:00000080:2.0:1784404809.093391:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd574d7e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784404809.093398:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd574c04800), last request at 1784404590 00000020:00000080:2.0:1784404809.093401:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78a2b 00000100:00080000:2.0:1784404809.093405:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd574c01000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784404809.093413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d7e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784404809.093440:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442284000 for lustre-MDT0000 00000100:00100000:1.0:1784404809.093991:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950400 00000100:00100000:1.0:1784404809.094000:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950400 00000100:00100000:1.0:1784404809.094064:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784404809.094072:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:3649:x1871083728950400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404809.094089:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404809.094107:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541391400/0x24b3e2e6dcd78dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78de3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094122:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404809.094181:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3649:x1871083728950400:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404809.094188:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1784404809.094208:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784404809.094223:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094232:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821db000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404809.094235:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094259:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404809.094266:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404809.094271:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404809.094274:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784404809.094277:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784404809.094302:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094308:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404809.094331:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094338:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821db000/0x24b3e2e6dcd78ce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78cee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094350:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784404809.094353:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094358:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404809.094361:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094367:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404809.094381:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404809.094386:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784404809.094388:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784404809.094389:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784404809.094406:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094411:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404809.094418:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094423:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7903d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79044 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094432:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404809.094435:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094554:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404809.094558:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094565:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404809.094571:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404809.094585:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404809.094588:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1784404809.094589:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784404809.094723:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094730:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404809.094742:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094748:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d209400/0x24b3e2e6dcd788a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd788aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.094758:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404809.094760:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404809.094762:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404809.094839:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950272 00000100:00100000:3.0:1784404809.094847:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950272 00000100:00100000:3.0:1784404809.094909:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1784404809.094919:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728950272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404809.094952:0:14219:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784404809.095013:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728950272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404809.095020:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1784404809.096750:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728950656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404809.097065:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728950400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404809.097091:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404809.097100:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728950784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404809.097153:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784404809.097245:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd574c04800): rc 0 00000020:00000080:2.0:1784404809.097248:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd574c04800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784404809.097259:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd57c5d4000), last request at 1784404590 00000020:00000080:2.0:1784404809.097266:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd789ec 00000100:00080000:2.0:1784404809.097275:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d7000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784404809.097295:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574c04800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784404809.097331:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574c01000 for lustre-MDT0000 00000001:00000004:2.0:1784404809.097342:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1784404809.097439:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd57c5d4000): rc 0 00000100:00100000:1.0:1784404809.097911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404809.097944:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784404809.097954:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728950528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404809.097975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404809.098166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950784 00000100:00100000:1.0:1784404809.098174:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950784 00000100:00100000:1.0:1784404809.098227:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950656 00000100:00100000:1.0:1784404809.098231:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950656 00000100:00100000:1.0:1784404809.098243:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950528 00000100:00100000:1.0:1784404809.098246:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950528 00000100:00100000:1.0:1784404809.098262:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784404809.098270:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+24:3649:x1871083728950784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404809.098295:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404809.098314:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031200/0x24b3e2e6dcd788aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd788a3 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.098331:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404809.098372:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+23:3649:x1871083728950784:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404809.098379:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784404809.098396:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404809.098402:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+22:3647:x1871083728950656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404809.098409:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404809.098418:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c6c00/0x24b3e2e6dcd79044 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7903d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404809.098427:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404809.098632:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784404809.098643:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+21:3647:x1871083728950528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404809.098652:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404809.098660:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151be00/0x24b3e2e6dcd78cee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ce7 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404809.098669:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404809.098714:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+20:3647:x1871083728950528:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404809.098721:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784404809.098763:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728950528:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1784404809.098960:0:15151:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc2ae0145bae0 00000100:00080000:2.0:1784404809.098998:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784404809.099007:0:15151:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443d84a80 x1871083728950272/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784404825 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404809.099018:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1784404809.101929:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3647:x1871083728950656:12345-0@lo:103:ldlm_bl.0 Request processed in 3515us (4006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404809.101945:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784404809.102031:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728950784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404809.102068:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404809.102078:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404809.102098:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728950272:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784404809.102115:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784404809.103055:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784404809.103088:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784404809.103432:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784404809.103437:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000100:00100000:1.0:1784404809.103542:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728950912:0@lo:39:umount.0 00000100:00100000:1.0:1784404809.103623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784404809.103848:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784404809.103931:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784404809.103945:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd577f06800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784404809.103958:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784404809.103961:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1784404809.103972:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784404809.104042:0:15151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784404809.104052:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784404809.104084:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd545b93380) has no exports 00000100:00100000:1.0:1784404809.104148:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728951040:0@lo:9:umount.0 00000100:00100000:1.0:1784404809.104202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404809.104233:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728951168:0@lo:9:umount.0 00000100:00100000:1.0:1784404809.104254:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404809.104316:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951040 00000100:00100000:2.0:1784404809.104323:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951040 00000100:00100000:2.0:1784404809.104379:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951168 00000100:00100000:2.0:1784404809.104382:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951168 00000100:00100000:2.0:1784404809.104401:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784404809.104409:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1871083728951040:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784404809.104433:0:8488:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78bd6 00000100:00080000:2.0:1784404809.104453:0:8488:0:(import.c:65:import_set_state_nolock()) ffff9dd574d79800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404809.104496:0:8488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1784404809.104796:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3645:x1871083728951040:12345-0@lo:9:umount.0 Request processed in 386us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404809.104804:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784404809.104822:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784404809.104829:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1871083728951168:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784404809.104842:0:8488:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d18 00000100:00080000:2.0:1784404809.104847:0:8488:0:(import.c:65:import_set_state_nolock()) ffff9dd443339000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404809.104901:0:8488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784404809.104972:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3645:x1871083728951168:12345-0@lo:9:umount.0 Request processed in 143us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404809.104978:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1784404809.105005:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404809.105010:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784404809.105037:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd577f06800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784404809.105189:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3647:1871083728950656:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1784404809.105584:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404809.105589:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404809.105739:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728950912 00000100:00100000:3.0:1784404809.105746:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728950912 00000100:00100000:3.0:1784404809.108623:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784404809.108653:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1871083728950912:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784404809.108692:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78a9b 00000100:00080000:3.0:1784404809.108713:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9dd57395b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784404809.108745:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1784404809.109070:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3645:x1871083728950912:12345-0@lo:39:umount.0 Request processed in 431us (5445us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784404809.109079:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00010000:1.0:1784404809.109255:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784404809.111003:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784404809.111011:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404809.111019:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728951040:0@lo:9:umount.0 00000100:00080000:2.0:1784404809.111061:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784404809.111110:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784404809.111270:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404809.111275:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728951168:0@lo:9:umount.0 00000100:00080000:2.0:1784404809.111295:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784404809.111300:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728950912:0@lo:39:umount.0 00000020:00080000:0.0:1784404809.119453:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd545b93380) has no exports 00000020:00000080:0.0:1784404809.177269:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd788fe 00000020:00000080:0.0:1784404809.177284:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd573841000/lustre-QMT0000_UUID 00000020:01000000:0.0:1784404809.177337:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784404809.177431:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404809.177452:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784404809.177457:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9dd570460000) has no exports 00000020:00000080:1.0:1784404809.177761:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd788f7 00000020:00000080:1.0:1784404809.177767:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd57059a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784404809.177797:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573841000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784404809.178107:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57059a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784404809.178169:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404809.178177:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784404809.178180:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd550785000/lustre-QMT0000_UUID 00000020:00000080:1.0:1784404809.178183:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd550785000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1784404809.178190:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1784404809.987807:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404810.116765:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728951296:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1784404810.116785:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784404810.116794:0:9511:0:(genops.c:885:class_export_put()) final put ffff9dd44333c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784404810.116811:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:0.0:1784404810.116814:0:9511:0:(genops.c:885:class_export_put()) final put ffff9dd5462d7800/1827e730-172d-4769-8ecb-95f4e65fc8a0 00000100:00100000:1.0:1784404810.116879:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404810.116981:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951296 00000100:00100000:1.0:1784404810.116991:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951296 00000020:00000080:2.0:1784404810.117003:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44333c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000100:00100000:1.0:1784404810.117042:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000020:00000080:2.0:1784404810.117060:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5462d7800/1827e730-172d-4769-8ecb-95f4e65fc8a0 for lustre-OST0001 00000100:00100000:1.0:1784404810.117064:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1871083728951296:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1784404810.117075:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000020:00000080:2.0:1784404810.117089:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443339000 for lustre-OST0001 00000020:00000080:2.0:1784404810.117102:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd5462d5800 for lustre-OST0001 00000100:02020000:0.0:1784404810.117210:0:3649:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1784404810.117332:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1871083728951296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (249us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784404810.117342:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000001:00100000:2.0:1784404810.118916:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784404810.118924:0:8427:0:(genops.c:885:class_export_put()) final put ffff9dd441a62000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784404810.118951:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:2.0:1784404810.118954:0:8427:0:(genops.c:885:class_export_put()) final put ffff9dd443cf0000/1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:3.0:1784404810.119104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a62000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784404810.119161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443cf0000/1827e730-172d-4769-8ecb-95f4e65fc8a0 for lustre-OST0000 00000020:00000080:3.0:1784404810.119177:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574d79800 for lustre-OST0000 00000020:00000080:3.0:1784404810.119181:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443cf2800 for lustre-OST0000 00000100:00080000:0.0:1784404810.127950:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404810.127961:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784404810.127966:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00100000:2.0:1784404810.135457:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784404810.135482:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1784404810.135489:0:7451:0:(genops.c:885:class_export_put()) final put ffff9dd574d3d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784404810.135523:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00080000:2.0:1784404810.135529:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1784404810.135532:0:7451:0:(genops.c:885:class_export_put()) final put ffff9dd443683800/699a5e6e-e921-4091-819a-62d5132b8ddf 00000001:00100000:2.0:1784404810.135539:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1827e730-172d-4769-8ecb-95f4e65fc8a0 00000001:00080000:2.0:1784404810.135545:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1784404810.135547:0:7451:0:(genops.c:885:class_export_put()) final put ffff9dd443581800/1827e730-172d-4769-8ecb-95f4e65fc8a0 00000020:00000080:3.0:1784404810.135644:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d3d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784404810.135721:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443683800/699a5e6e-e921-4091-819a-62d5132b8ddf for lustre-MDT0001 00000020:00000080:3.0:1784404810.135745:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443581800/1827e730-172d-4769-8ecb-95f4e65fc8a0 for lustre-MDT0001 00000020:00000080:3.0:1784404810.135778:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd57395b000 for lustre-MDT0001 00000020:00000080:3.0:1784404810.135783:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443686000 for lustre-MDT0001 00000020:00000080:3.0:1784404810.135787:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443587800 for lustre-MDT0001 00000100:00080000:0.0:1784404810.141758:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404810.141772:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 207 00000100:00080000:0.0:1784404810.141782:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd57c5d5800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404810.141926:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443631180 x1871083728951424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404810.143839:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728951424:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784404810.143968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404810.144465:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951424 00000100:00100000:1.0:1784404810.144475:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951424 00000100:00100000:1.0:1784404810.144527:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784404810.144552:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1871083728951424:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1784404810.144572:0:14219:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784404810.155370:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1871083728951424:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 10808us (11392us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404810.155397:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1784404810.155625:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404810.155632:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404810.155637:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728951424:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1784404811.012479:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404812.035581:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404812.675769:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404812.675798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728951552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404812.675902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404812.676210:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951552 00000100:00100000:0.0:1784404812.676219:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951552 00000100:00100000:0.0:1784404812.676279:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784404812.676288:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728951552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784404812.676332:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784404812.676379:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728951552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404812.676386:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1784404812.676427:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404812.676443:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784404812.676446:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404812.676451:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1784404812.676455:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784404812.676459:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd57c5d5800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404812.676481:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443631500 x1871083728951808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404812.676620:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728952064:0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.676653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404812.676682:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728952576:0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.676706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404812.676726:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784404812.676731:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728951936:0@lo:400:kworker.0 00000100:00100000:1.0:1784404812.676752:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728952192:0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.676752:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404812.676769:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728952448:0@lo:400:kworker.0 00000100:00100000:1.0:1784404812.676782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404812.676794:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952064 00000100:00100000:0.0:1784404812.676798:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952064 00000100:00100000:1.0:1784404812.676804:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784404812.676809:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728951680:0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.676819:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951936 00000100:00100000:0.0:1784404812.676821:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951936 00000100:00100000:0.0:1784404812.676833:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952192 00000100:00100000:0.0:1784404812.676835:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952192 00000100:00100000:1.0:1784404812.676836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404812.676978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1784404812.676987:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728952192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404812.677031:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728952192:12345-0@lo:400:kworker.0 Request processed in 45us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404812.677037:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1784404812.677052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784404812.677056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1871083728952064:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784404812.677061:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784404812.677081:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1871083728952064:12345-0@lo:400:kworker.0 Request processed in 24us (428us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784404812.677086:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784404812.677095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784404812.677099:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1871083728951936:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784404812.677114:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784404812.677133:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1871083728951936:12345-0@lo:400:kworker.0 Request processed in 33us (380us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784404812.677137:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784404812.677173:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728951552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404812.677188:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404812.677193:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728952704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404812.677213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404812.677237:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952576 00000100:00100000:2.0:1784404812.677240:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952576 00000100:00100000:2.0:1784404812.677268:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784404812.677275:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728952576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404812.677307:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728952576:12345-0@lo:400:kworker.0 Request processed in 33us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404812.677313:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784404812.677342:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728951808:0@lo:38:kworker.0 00000100:00100000:2.0:1784404812.677370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404812.677393:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951808 00000100:00100000:2.0:1784404812.677396:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951808 00000100:00100000:2.0:1784404812.677416:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784404812.677421:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728951808:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1784404812.677434:0:6524:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784404812.677506:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728952320:0@lo:400:kworker.0 00000100:00100000:1.0:1784404812.677532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784404812.677558:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443630700 x1871083728952192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404812.677568:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728952192:0@lo:400:kworker.0 00000100:00100000:1.0:1784404812.677591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952320 00000100:00100000:1.0:1784404812.677594:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952320 00000100:00100000:1.0:1784404812.677611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784404812.677615:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1871083728952320:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784404812.677620:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784404812.677662:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1871083728952320:12345-0@lo:400:kworker.0 Request processed in 45us (129us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784404812.677677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784404812.677741:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728951680 00000100:00100000:1.0:1784404812.677746:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728951680 00000100:00100000:0.0:1784404812.677764:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952704 00000100:00100000:0.0:1784404812.677768:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952704 00000100:00100000:1.0:1784404812.677780:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1784404812.677786:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3646:x1871083728951680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.677788:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784404812.677793:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728952704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784404812.677810:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784404812.677817:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3646:x1871083728951680:12345-0@lo:400:kworker.0 Request processed in 31us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404812.677823:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1784404812.677843:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728952704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404812.677878:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728951680:0@lo:400:kworker.0 00000100:00080000:1.0:1784404812.677889:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784404812.677894:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784404812.677898:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1784404812.678044:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784404812.678070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784404812.678391:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404812.678396:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404812.678399:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404812.678419:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952448 00000100:00100000:3.0:1784404812.678423:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952448 00000100:00100000:3.0:1784404812.678469:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1784404812.678476:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728952448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404812.678516:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083728952448:12345-0@lo:400:kworker.0 Request processed in 41us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404812.678522:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:3.0:1784404812.678536:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404812.678629:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404812.678634:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784404812.678638:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784404812.678643:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404812.678648:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 225 00000100:00080000:0.0:1784404812.678653:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd573b4b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404812.678686:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443632a00 x1871083728952832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404812.678701:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728952064:0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.678716:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728952576:0@lo:400:kworker.0 00000100:00080000:0.0:1784404812.678735:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404812.678737:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784404812.678741:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784404812.678743:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404812.678746:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 207 00000100:00080000:0.0:1784404812.678750:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd574c00000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404812.678760:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443630000 x1871083728952960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404812.678769:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728951936:0@lo:400:kworker.0 00010000:00080000:0.0:1784404812.678787:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443633480 x1871083728952448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404812.678796:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728952448:0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.678832:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728952704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404812.678966:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728952832:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784404812.679000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404812.679023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952832 00000100:00100000:3.0:1784404812.679027:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952832 00000100:00100000:3.0:1784404812.679049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784404812.679053:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728952832:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1784404812.679065:0:6519:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784404812.679090:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728952832:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36us (90us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784404812.679096:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1784404812.679133:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404812.679137:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404812.679141:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728952832:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784404812.679146:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728952960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784404812.679167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404812.679186:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728952960 00000100:00100000:3.0:1784404812.679189:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728952960 00000100:00100000:3.0:1784404812.679203:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784404812.679207:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728952960:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1784404812.679213:0:13543:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784404812.679243:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728952960:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35us (75us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784404812.679249:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1784404812.679270:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404812.679273:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404812.679276:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728952960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784404812.687034:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728951808:12345-0@lo:38:kworker.0 Request processed in 9603us (9654us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784404812.687050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1784404812.687336:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404812.687342:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784404812.687346:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728951808:0@lo:38:kworker.0 00000100:00080000:1.0:1784404812.727197:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404812.727212:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 244 00000100:00080000:1.0:1784404812.727221:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404812.727293:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd541665500 x1871083728953088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404812.731155:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083728952320:0@lo:400:kworker.0 00000100:00100000:0.0:1784404812.731320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728953088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784404812.731406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404812.731963:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953088 00000100:00100000:1.0:1784404812.731973:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953088 00000100:00100000:1.0:1784404812.732054:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784404812.732062:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728953088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1784404812.732081:0:13543:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784404812.732142:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728953088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 79us (735us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404812.732148:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1784404812.732585:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404812.732592:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784404812.732596:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728953088:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1784404813.059145:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784404813.827789:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784404814.084372:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404815.107440:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784404815.242244:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784404815.242268:0:6498:0:(genops.c:885:class_export_put()) final put ffff9dd57c5d4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784404815.242425:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57c5d4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784404815.242498:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd57c5d7000 for lustre-MDT0000 00010000:00010000:2.0:1784404816.131393:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404817.155267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404817.795104:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728953344:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784404817.795148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404817.795153:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784404817.795156:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404817.795161:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:1.0:1784404817.795166:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784404817.795172:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd57c5d5800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404817.795180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404817.795194:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd541667800 x1871083728953600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404817.795238:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728953216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404817.795262:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404817.795262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404817.795269:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728953472:0@lo:400:kworker.0 00000100:00100000:2.0:1784404817.795295:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953344 00000100:00100000:2.0:1784404817.795304:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953344 00000100:00100000:3.0:1784404817.795305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404817.795349:0:10095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953216 00000100:00100000:2.0:1784404817.795352:0:10095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953216 00000100:00100000:2.0:1784404817.795369:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784404817.795378:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728953344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404817.795406:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784404817.795446:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728953344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404817.795465:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784404817.795481:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784404817.795487:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728953216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404817.795501:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784404817.795526:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728953216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404817.795531:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784404817.795568:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728953344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404817.795578:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728953216:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784404817.795616:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404817.795620:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404817.812347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404817.812358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784404817.812362:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404817.812370:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:1.0:1784404817.812376:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784404817.812383:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd574c00000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404817.812429:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd541664a80 x1871083728953728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404817.812445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404817.812449:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784404817.812450:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404817.812454:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 430 00000100:00080000:1.0:1784404817.812456:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784404817.812460:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd573b4b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404817.812473:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd541665500 x1871083728953856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404817.812536:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404817.812540:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784404817.812542:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404817.812545:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 430 00000100:00080000:1.0:1784404817.812547:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784404817.812551:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404817.812563:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d8ad80 x1871083728954112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404817.812637:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784404817.812655:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728954240:0@lo:400:kworker.0 00000100:00100000:1.0:1784404817.812728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404817.813319:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728953600:0@lo:38:kworker.0 00000100:00100000:0.0:1784404817.813367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404817.813434:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728953728:0@lo:38:kworker.0 00000100:00100000:0.0:1784404817.813460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404817.813483:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728953856:0@lo:38:kworker.0 00000100:00100000:0.0:1784404817.813503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404817.813520:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728954112:0@lo:38:kworker.0 00000100:00100000:0.0:1784404817.813539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404817.813578:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728954240 00000100:00100000:0.0:1784404817.813587:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728954240 00000100:00100000:0.0:1784404817.813668:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953728 00000100:00100000:0.0:1784404817.813672:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953728 00000100:00100000:0.0:1784404817.813681:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953856 00000100:00100000:0.0:1784404817.813683:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953856 00000100:00100000:0.0:1784404817.813690:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728954112 00000100:00100000:0.0:1784404817.813692:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728954112 00000100:00100000:0.0:1784404817.813704:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1784404817.813714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728954240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404817.813775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728954240:12345-0@lo:400:kworker.0 Request processed in 62us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404817.813783:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1784404817.813801:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784404817.813806:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1871083728953728:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1784404817.813822:0:6520:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:00080000:1.0:1784404817.815043:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d89f80 x1871083728954240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404817.815060:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728954240:0@lo:400:kworker.0 00000100:00100000:2.0:1784404817.815087:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404817.815096:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784404817.815100:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728953984:0@lo:400:kworker.0 00000100:00100000:1.0:1784404817.815102:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728953856:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1784404817.815115:0:13543:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784404817.815144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404817.815156:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728953856:12345-0@lo:38:kworker.0 Request processed in 54us (1653us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404817.815163:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784404817.815192:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953984 00000100:00100000:2.0:1784404817.815197:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953984 00000100:00100000:2.0:1784404817.817355:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1784404817.817363:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784404817.817370:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728954112:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784404817.817374:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728953984:12345-0@lo:400:kworker.0 00010000:02000000:1.0:1784404817.817387:0:13543:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784404817.820656:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728953984:12345-0@lo:400:kworker.0 Request processed in 3279us (5498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404817.820672:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00080000:2.0:1784404817.820753:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d8a300 x1871083728953984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404817.820768:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728953984:0@lo:400:kworker.0 00000100:00100000:2.0:1784404817.820892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953472 00000100:00100000:2.0:1784404817.820901:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953472 00000100:00100000:2.0:1784404817.820945:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1784404817.820954:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3649:x1871083728953472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404817.821009:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3649:x1871083728953472:12345-0@lo:400:kworker.0 Request processed in 57us (25704us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404817.821015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1784404817.821049:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728953600 00000100:00100000:2.0:1784404817.821052:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728953600 00000100:00100000:2.0:1784404817.821071:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784404817.821075:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083728953600:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1784404817.821092:0:6525:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784404817.821124:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083728953600:12345-0@lo:38:kworker.0 Request processed in 47us (7757us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784404817.821129:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1784404817.821146:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404817.821172:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404817.821177:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404817.821180:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728953600:0@lo:38:kworker.0 00000100:00080000:2.0:1784404817.821192:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404817.821195:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404817.821198:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728953856:0@lo:38:kworker.0 00000100:00100000:1.0:1784404817.826813:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728954112:12345-0@lo:38:kworker.0 Request processed in 9435us (13265us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404817.826843:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1784404817.827498:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404817.827505:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404817.827509:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728954112:0@lo:38:kworker.0 00000100:00100000:2.0:1784404817.827671:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3649:1871083728953472:0@lo:400:kworker.0 00000100:00100000:0.0:1784404817.843891:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1871083728953728:12345-0@lo:38:kworker.0 Request processed in 30072us (30418us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784404817.843909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1784404817.846415:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784404817.846428:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784404817.846432:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728953728:0@lo:38:kworker.0 00010000:00010000:1.0:1784404818.181173:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404819.203155:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404820.227221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404821.255367:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404822.277170:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404822.915616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728954368:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784404822.915669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784404822.915673:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784404822.915677:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404822.915682:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1784404822.915687:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1784404822.915692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784404822.915693:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd57c5d5800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404822.915714:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d84000 x1871083728954752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404822.915732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784404822.915735:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784404822.915737:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404822.915740:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1784404822.915742:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784404822.915745:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd574c00000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404822.915756:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242f480 x1871083728954880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404822.915775:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728954752:0@lo:38:kworker.0 00000100:00080000:3.0:1784404822.915784:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784404822.915787:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784404822.915788:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404822.915792:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1784404822.915794:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784404822.915798:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd573b4b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404822.915802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404822.915809:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242df80 x1871083728955008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404822.915822:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728954880:0@lo:38:kworker.0 00000100:00080000:3.0:1784404822.915835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784404822.915838:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784404822.915840:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404822.915843:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1784404822.915845:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1784404822.915845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784404822.915874:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404822.915879:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728955008:0@lo:38:kworker.0 00000100:00100000:3.0:1784404822.915886:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242d880 x1871083728955392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404822.915898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404822.915913:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728955392:0@lo:38:kworker.0 00000100:00100000:3.0:1784404822.915925:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728955136:0@lo:400:kworker.0 00000100:00100000:1.0:1784404822.915934:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404822.915949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404822.915960:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728954752 00000100:00100000:3.0:1784404822.915968:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404822.915968:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728954752 00000100:00100000:3.0:1784404822.915973:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728955264:0@lo:400:kworker.0 00000100:00100000:3.0:1784404822.915994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404822.915997:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784404822.916005:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1871083728954752:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1784404822.916021:0:14219:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784404822.916088:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728955264 00000100:00100000:3.0:1784404822.916092:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728955264 00000100:00100000:3.0:1784404822.916129:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784404822.916141:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728955264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404822.916189:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728955264:12345-0@lo:400:kworker.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404822.916196:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784404822.916232:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728955264:0@lo:400:kworker.0 00000100:00100000:3.0:1784404822.916268:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728954880 00000100:00100000:3.0:1784404822.916272:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728954880 00000100:00100000:3.0:1784404822.916288:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728955008 00000100:00100000:3.0:1784404822.916290:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728955008 00000100:00100000:3.0:1784404822.916297:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728955392 00000100:00100000:3.0:1784404822.916299:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728955392 00000100:00100000:3.0:1784404822.916307:0:13543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728955136 00000100:00100000:3.0:1784404822.916309:0:13543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728955136 00000100:00100000:3.0:1784404822.916326:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784404822.916333:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728955136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404822.916368:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728955136:12345-0@lo:400:kworker.0 Request processed in 35us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404822.916374:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784404822.916386:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784404822.916389:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728954880:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784404822.916396:0:13543:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784404822.916424:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728954880:12345-0@lo:38:kworker.0 Request processed in 33us (578us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784404822.916430:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784404822.916757:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728954496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404822.916788:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404822.916811:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728955520:0@lo:400:kworker.0 00000100:00100000:2.0:1784404822.916832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404822.916844:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404822.916866:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728954624:0@lo:400:kworker.0 00000100:00100000:2.0:1784404822.916893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404822.916930:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728955520 00000100:00100000:2.0:1784404822.916934:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728955520 00000100:00100000:2.0:1784404822.916957:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784404822.916964:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728955520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404822.916998:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728955520:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404822.917004:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1784404822.917102:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784404822.917107:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728955008:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784404822.917117:0:13543:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784404822.917152:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728955008:12345-0@lo:38:kworker.0 Request processed in 43us (1252us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784404822.917157:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784404822.917170:0:13543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784404822.917174:0:13543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728955392:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784404822.917181:0:13543:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784404822.917204:0:13543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1871083728955392:12345-0@lo:38:kworker.0 Request processed in 29us (1268us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784404822.917209:0:13543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:3.0:1784404822.917240:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242e680 x1871083728955136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404822.917251:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728955136:0@lo:400:kworker.0 00000100:00080000:3.0:1784404822.917277:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404822.917281:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404822.917283:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728955392:0@lo:38:kworker.0 00000100:00080000:3.0:1784404822.917291:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404822.917294:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404822.917296:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728954880:0@lo:38:kworker.0 00000100:00080000:3.0:1784404822.917303:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404822.917317:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404822.917320:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728955008:0@lo:38:kworker.0 00000100:00080000:3.0:1784404822.917354:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404822.917359:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404822.917383:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728954368 00000100:00100000:3.0:1784404822.917386:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728954368 00000100:00100000:3.0:1784404822.917422:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728954496 00000100:00100000:3.0:1784404822.917425:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728954496 00000100:00100000:2.0:1784404822.917520:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728954624 00000100:00100000:2.0:1784404822.917524:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728954624 00000100:00100000:2.0:1784404822.917553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1784404822.917560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3648:x1871083728954624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404822.917600:0:10095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784404822.917607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd58157f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3+19:3648:x1871083728954624:12345-0@lo:400:kworker.0 Request processed in 48us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404822.917609:0:10095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728954368:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404822.917613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00002000:00000024:0.0:1784404822.917628:0:10095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784404822.917658:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784404822.917661:0:10095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728954368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404822.917665:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728954496:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404822.917667:0:10095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00002000:00000024:3.0:1784404822.917679:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784404822.917705:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728954496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404822.917710:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728954368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404822.917711:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784404822.917754:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728954624:0@lo:400:kworker.0 00000100:00100000:0.0:1784404822.917766:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728954496:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1784404822.917788:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242c000 x1871083728955520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404822.917796:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728955520:0@lo:400:kworker.0 00000100:00080000:2.0:1784404822.921225:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404822.943461:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1871083728954752:12345-0@lo:38:kworker.0 Request processed in 27446us (27648us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404822.943735:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:0.0:1784404822.943890:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404822.943896:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784404822.943899:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728954752:0@lo:38:kworker.0 00000040:00080000:0.0:1784404823.043706:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784404823.309245:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:2.0:1784404823.426942:0:15151:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:2.0:1784404823.442787:0:15151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5624f16c0 - data ffff9dd566363870/ffff9dd4431af400 00000020:01000000:2.0:1784404823.443097:0:15151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5706030c0 - data ffff9dd566195438/ffff9dd5739b1000 00000001:00000004:2.0:1784404823.449352:0:15151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1784404823.524599:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784404823.524619:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1784404823.524635:0:15151:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd570592d80 x1871083728950912/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784404819 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404823.524661:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784404823.531062:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784404823.531071:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1784404823.531130:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784404823.531133:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784404823.531845:0:8486:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784404823.531868:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1784404823.531878:0:8486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1784404823.535760:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784404823.535768:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1784404823.535788:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784404823.535790:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784404823.536466:0:9913:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784404823.536471:0:9913:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1784404823.536483:0:9913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1784404823.562412:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd788c6 00000020:00000080:2.0:1784404823.562428:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd565e07800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784404823.572315:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e07800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784404823.577240:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd788db 00000020:00000080:2.0:1784404823.577255:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd565e8d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784404823.577277:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784404823.577284:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404823.577292:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784404823.577297:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9dd545b919c0) has no exports 00000004:01000000:2.0:1784404823.577478:0:15151:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784404823.577487:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d11 00000020:00000080:2.0:1784404823.577492:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd577f5f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784404823.577496:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784404823.577499:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404823.577507:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784404823.577511:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9dd573a8b380) has no exports 00000020:00000080:2.0:1784404823.577517:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78d0a 00000020:00000080:2.0:1784404823.577521:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd443587000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784404823.579279:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e8d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1784404823.579294:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd577f5f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784404823.579300:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443587000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784404823.579595:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784404823.579599:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784404823.579604:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1784404823.579609:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404823.579611:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784404823.579656:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404823.579679:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784404823.579687:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78bcf 00000020:00000080:2.0:1784404823.579694:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd442281000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784404823.579698:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784404823.579703:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404823.579708:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784404823.579712:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9dd573b18000) has no exports 00000020:00000080:2.0:1784404823.579717:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78bc8 00000020:00000080:2.0:1784404823.579720:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd577f05000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784404823.580242:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443585000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784404823.580251:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd550782000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784404823.580254:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd550782000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784404823.580259:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784404823.580341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442281000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784404823.580346:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd577f05000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784404823.580465:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784404823.580469:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784404823.580472:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1784404823.580476:0:15151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404823.580478:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784404823.580515:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404823.580522:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1784404823.580535:0:15151:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784404823.580542:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78a94 00000020:00000080:2.0:1784404823.580547:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd573aab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784404823.580551:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd577f06800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784404823.580556:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd57b4e5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784404823.580557:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1784404823.580558:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57b4e5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784404823.580561:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:01000000:3.0:1784404823.580562:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784404823.580565:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784404823.580567:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9dd573a88000) has no exports 00000020:00000080:2.0:1784404823.580582:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78a8d 00000020:00000080:2.0:1784404823.580585:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd573b4a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784404823.580606:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aab800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784404823.580611:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573b4a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784404823.587931:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1784404823.587942:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784404823.587948:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1784404823.587957:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784404823.587987:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd573b4f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784404823.588032:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404823.588046:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784404823.588051:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd565e04000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784404823.588055:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e04000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784404823.588062:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784404823.588302:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404823.588307:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784404823.588310:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd565e07000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784404823.588313:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e07000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784404823.588318:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784404823.588370:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd788e2 00000020:00000080:3.0:1784404823.588377:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd565e8f000/lustre-MDD0000_UUID 00000020:01000000:3.0:1784404823.588393:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784404823.588398:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404823.588402:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784404823.588406:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9dd545b90000) has no exports 00000020:00000080:3.0:1784404823.588424:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404823.588427:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784404823.588430:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd788e9 00000020:00000080:3.0:1784404823.588434:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd565e8c000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784404823.588442:0:15151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd544dfc000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784404823.588445:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd544dfc000 3 00000020:01000004:3.0:1784404823.588448:0:15151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd544dfc000 from lustre-MDT0000 00000020:00000080:3.0:1784404823.588462:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404823.588465:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784404823.588467:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd565e02000/lustre-MDT0000_UUID 00000020:00000080:3.0:1784404823.588480:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e02000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784404823.588487:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1784404823.588488:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e8f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784404823.588492:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd565e89000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784404823.588494:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e89000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784404823.588502:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1784404823.588517:0:15151:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1784404823.588522:0:15151:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784404823.588525:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784404823.588527:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404823.588530:0:15151:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784404823.588536:0:15151:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9dd54803f000 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1784404823.588540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e8c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1784404823.588541:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9dd570463380) has exports, disconnecting them 00000020:00080000:3.0:1784404823.588546:0:15151:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dd54803f000), last request at 1784404572 00000020:00000080:3.0:1784404823.588559:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78887 00000020:00010000:3.0:1784404823.588563:0:15151:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd54803f000: total 0 00000100:00080000:3.0:1784404823.588567:0:15151:0:(import.c:65:import_set_state_nolock()) ffff9dd548219800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784404823.588593:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd54803f000): rc 0 00000020:00080000:3.0:1784404823.588597:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9dd570463380) has no exports 00000020:00010000:1.0:1784404823.588674:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd54803f000: total 0 00000100:00100000:3.0:1784404823.588675:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dd56d420400:6514] 2 exiting: rc = 0 00010000:00010000:1.0:1784404823.588696:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd54803f000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784404823.588724:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd78db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dab expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588738:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549000/0x24b3e2e6dcd78da4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d9d expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588750:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540030000/0x24b3e2e6dcd78983 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7897c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588763:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541391a00/0x24b3e2e6dcd78dc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78db9 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588788:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd78dce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78dc7 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588799:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d209e00/0x24b3e2e6dcd78991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7898a expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588811:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540030800/0x24b3e2e6dcd7901a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79013 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588821:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd79028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79021 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588836:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390400/0x24b3e2e6dcd78df8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78df1 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588849:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd541390a00/0x24b3e2e6dcd78d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d81 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588881:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548600/0x24b3e2e6dcd79036 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7902f expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588892:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd78d96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78d8f expref: 3 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588905:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd56d209200/0x24b3e2e6dcd78ca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd78ca1 expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404823.588915:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd54803f000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784404823.588929:0:6507:0:(genops.c:885:class_export_put()) final put ffff9dd54803f000/4364c714-0ef8-4a4f-a8e5-bb2917aa36f3 00010000:00010000:1.0:1784404823.588946:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404823.588954:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404823.588956:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784404823.588964:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd54803f000/4364c714-0ef8-4a4f-a8e5-bb2917aa36f3 for MGS 00000020:00000080:3.0:1784404823.588986:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd548219800 for MGS 00000100:00100000:1.0:1784404823.588996:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dd55271b400:6511] 0 exiting: rc = 1 00000100:00100000:0.0:1784404823.590157:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dd55271b800:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1784404823.590263:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590271:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590278:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590284:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590289:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590296:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590302:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590307:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590313:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590319:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590324:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590329:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590335:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590340:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590356:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590361:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590366:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590371:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590376:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590382:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590388:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590394:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590401:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590406:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590413:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590418:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590424:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590430:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590435:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590441:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590446:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590451:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590457:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590463:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590469:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590474:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590479:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590485:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590491:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590496:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590501:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590506:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590511:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590516:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590520:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590525:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590531:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590536:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590541:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590554:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590559:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590564:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590570:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590589:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590594:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590599:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590604:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590609:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590615:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590620:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590625:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590631:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590636:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404823.590642:0:15151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1784404823.593655:0:15151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5624f1480 - data ffff9dd5663635e8/ffff9dd4431ad800 00000020:01000000:3.0:1784404823.593775:0:15151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd570603420 - data ffff9dd549055af8/ffff9dd5482ce800 00000020:00000080:3.0:1784404823.594381:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7886b 00000020:00000080:3.0:1784404823.594391:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd546700000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784404823.594420:0:15151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd544dfc000 from MGS, refs=2 00000020:01000004:3.0:1784404823.594424:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd544dfc000 2 00000020:01000004:3.0:1784404823.594427:0:15151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd544dfc000 from MGS 00000020:00000080:3.0:1784404823.594448:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404823.594455:0:15151:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784404823.594459:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd54803a000/MGS 00000020:00000080:3.0:1784404823.594462:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd54803a000/MGS for MGS 00000020:01000000:3.0:1784404823.594468:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784404823.594537:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784404823.594541:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404823.594547:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784404823.594554:0:15151:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dd57394d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784404823.594559:0:15151:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9dd5453e4d40) has exports, disconnecting them 00000020:00080000:3.0:1784404823.594563:0:15151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dd57394d800), last request at 1784404572 00000020:00000080:3.0:1784404823.594592:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78936 00000020:00080000:3.0:1784404823.594604:0:15151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd57394d800): rc 0 00000020:00000080:3.0:1784404823.594608:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd57394d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784404823.595306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd546700000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784404823.595316:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57394d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1784404823.729933:0:15151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1784404823.729942:0:15151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404823.729946:0:15151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784404823.729954:0:15151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404823.729990:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd57394b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784404823.730355:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404823.730364:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784404823.730369:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd57394e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784404823.730373:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57394e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784404823.730384:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1784404823.730465:0:15151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd544dfc000 1 00000020:00000080:1.0:1784404823.730471:0:15151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7885d 00000020:00000080:1.0:1784404823.730477:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd54803d800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1784404823.730487:0:15151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1784404823.730496:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd54803d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784404823.730506:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404823.730510:0:15151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784404823.730514:0:15151:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9dd5453e3380) has no exports 00000020:00000080:1.0:1784404823.860470:0:15151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404823.860484:0:15151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784404823.860490:0:15151:0:(genops.c:885:class_export_put()) final put ffff9dd544dfd000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404823.860494:0:15151:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd544dfd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784404823.860501:0:15151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784404823.860635:0:15151:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd544dfe800 00000020:02000400:1.0:1784404823.860707:0:15151:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1784404824.323078:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404825.347076:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404826.371532:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784404827.383834:0:15354:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:3.0:1784404827.397682:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784404827.402285:0:15354:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1784404827.402341:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.402357:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.402366:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.402373:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.402436:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784404827.402442:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784404827.402473:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404827.402478:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784404827.402485:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784404827.402490:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9dd574c00000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1784404827.402495:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404827.402497:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784404827.402500:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784404827.403525:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.403537:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.403556:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.403581:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404040:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784404827.404048:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404057:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404827.404061:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404136:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404827.404144:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404827.404150:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784404827.404153:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784404827.404156:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784404827.404195:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404202:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784404827.404257:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1784404827.404278:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404286:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443549a00/0x24b3e2e6dcd78db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dc0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404312:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404827.404316:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404323:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dac00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404827.404326:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404334:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404827.404340:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404827.404346:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784404827.404348:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1784404827.404360:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404367:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404827.404386:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404827.404395:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404827.404397:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404827.404399:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404827.404416:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728955776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404827.404494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404827.404579:0:10336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728955776 00000100:00100000:3.0:1784404827.404592:0:10336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728955776 00000100:00100000:3.0:1784404827.404633:0:10336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784404827.404640:0:10336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57055ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083728955776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784404827.404646:0:10336:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404827 with bad export cookie 2644706887372081287 00010000:00010000:1.0:1784404827.406378:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784404827.406391:0:15354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821dac00/0x24b3e2e6dcd78dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78dce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406475:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406484:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406491:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406499:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406517:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784404827.406523:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406530:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406536:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406569:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406581:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784404827.406587:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406594:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406599:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406606:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404827.406613:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1784404827.406616:0:15354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1784404827.406623:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1784404827.406663:0:15354:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1784404827.406667:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1784404827.406672:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404827.406677:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784404827.406683:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd442736000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784404827.406688:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd441a66000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784404827.406692:0:15354:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9dd573b03380) has exports, disconnecting them 00000020:00080000:1.0:1784404827.406697:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd442736000), last request at 1784404822 00000020:00000080:1.0:1784404827.406703:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78c69 00000100:00080000:1.0:1784404827.406725:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9dd442735000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784404827.406762:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd442736000): rc 0 00000020:00000080:1.0:1784404827.406766:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd442736000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1784404827.406776:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd441a66000), last request at 1784404822 00000020:00000080:1.0:1784404827.406779:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78b43 00000100:00080000:1.0:1784404827.406784:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784404827.406794:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442736000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1784404827.406832:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442735000 for lustre-MDT0001 00000020:00080000:1.0:1784404827.406845:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd441a66000): rc 0 00000020:00000080:1.0:1784404827.406847:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd441a66000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1784404827.406878:0:15354:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc2ae01c9bae0 00000020:00000080:1.0:1784404827.406889:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a66000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1784404827.406924:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd441a60800 for lustre-MDT0001 00000100:00080000:1.0:1784404827.407013:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404827.407023:0:15354:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9dd443631f80 x1871083728951296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784404826 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404827.407037:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1784404827.408330:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784404827.408342:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408352:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404827.408368:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408378:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404827.408385:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404827.408390:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784404827.408393:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1784404827.408396:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1784404827.408435:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408442:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404827.408469:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408476:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208a00/0x24b3e2e6dcd78ca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78ca8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408495:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404827.408500:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408505:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404827.408508:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408514:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404827.408526:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404827.408531:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784404827.408533:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784404827.408535:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784404827.408560:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.408566:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1784404827.408769:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784404827.408775:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9dd57c5d5800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1784404827.408898:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728956032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404827.408984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404827.409029:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728955648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404827.409051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404827.409294:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728956032 00000100:00100000:0.0:1784404827.409301:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728956032 00000100:00100000:0.0:1784404827.409328:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728955648 00000100:00100000:0.0:1784404827.409331:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728955648 00000100:00100000:0.0:1784404827.409347:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784404827.409353:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1871083728956032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784404827.409360:0:6504:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404827 with bad export cookie 2644706887372081287 00000100:00100000:0.0:1784404827.409406:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1871083728956032:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (422us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784404827.409413:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784404827.409430:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784404827.409443:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1871083728955648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784404827.409447:0:6504:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404827 with bad export cookie 2644706887372081287 00000100:00100000:0.0:1784404827.409475:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1871083728955648:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (423us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784404827.409480:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1784404827.409509:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404827.409512:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9dd56cf4f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784404827.409516:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1784404827.409647:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.409657:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7902f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79036 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.409670:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404827.409675:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.409682:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404827.409685:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.409692:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404827.409700:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404827.409715:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784404827.409718:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784404827.409720:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784404827.409995:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404827.410001:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404827.410052:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784404827.410056:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1784404827.410078:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784404827.410141:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784404827.410156:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9dd57df4f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784404827.410169:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784404827.410171:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1784404827.410187:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784404827.410245:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784404827.410254:0:15354:0:(import.c:65:import_set_state_nolock()) ffff9dd442730800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784404827.410281:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9dd573b03380) has no exports 00000100:00100000:1.0:1784404827.421493:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728956160:0@lo:9:umount.0 00000100:00100000:1.0:1784404827.421585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404827.421625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728956288:0@lo:9:umount.0 00000100:00100000:1.0:1784404827.421647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784404827.432430:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.142@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784404827.432436:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784404827.432446:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443d1a300 x1871083728955776/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404843 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404827.432462:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd577ff9880 x1871083728956032/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404843 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404827.432472:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443d18380 x1871083728955648/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404843 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404827.432654:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728956160 00000100:00100000:2.0:1784404827.432665:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728956160 00000100:00100000:2.0:1784404827.432742:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728956288 00000100:00100000:2.0:1784404827.432746:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728956288 00000100:00100000:2.0:1784404827.432775:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784404827.432787:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1871083728956160:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784404827.432815:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78b97 00000100:00080000:2.0:1784404827.432823:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404827.432885:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1784404827.433141:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1871083728956160:12345-0@lo:9:umount.0 Request processed in 357us (11555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404827.433149:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784404827.433164:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784404827.433171:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1871083728956288:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784404827.433183:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78cd2 00000100:00080000:2.0:1784404827.433188:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9dd44319f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404827.433210:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784404827.433291:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1871083728956288:12345-0@lo:9:umount.0 Request processed in 120us (11643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404827.433298:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1784404827.433327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404827.433332:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784404827.433342:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404827.433362:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:0:1871083728955904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404827.433420:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404827.433446:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728951296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404827.433479:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3646:1871083728955776:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784404827.433517:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57df4f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784404827.433532:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784404827.433534:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404827.433548:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728956160:0@lo:9:umount.0 00000100:00080000:2.0:1784404827.433563:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd442730800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784404827.433571:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784404827.433573:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404827.433575:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728956288:0@lo:9:umount.0 00010000:00010000:2.0:1784404827.433620:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.433630:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404827.433650:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404827.433657:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d208800/0x24b3e2e6dcd7898a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd78991 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404827.433684:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:0:1871083728956416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404827.433708:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404827.433710:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404827.433713:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784404827.434469:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784404827.434474:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784404827.434476:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784404827.434480:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9dd56cf4f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404827.434486:0:3648:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 190 00000100:00080000:0.0:1784404827.434498:0:3648:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff9dd56cf4f000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404827.434547:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443632a00 x1871083728956544/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404827.434577:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3645:1871083728956544:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1784404827.434621:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871083728956544 offset 0 length 520: 4 00000100:00100000:0.0:1784404827.434669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728955648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404827.434702:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3648:1871083728956032:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1784404827.439771:0:10336:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1871083728955776 offset 224 length 224: 4 00000100:00100000:3.0:1784404827.439796:0:10336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57055ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083728955776:12345-0@lo:103:ldlm_bl.0 Request processed in 35154us (35301us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784404827.439808:0:10336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:1.0:1784404827.447278:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9dd573b03380) has no exports 00000020:01000000:0.0:1784404827.535741:0:15354:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5624f1840 - data ffff9dd566366af8/ffff9dd4431acc00 00000020:01000000:0.0:1784404827.535876:0:15354:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd551fc5de0 - data ffff9dd5662250d8/ffff9dd57c706000 00000001:00000004:2.0:1784404827.544521:0:15354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1784404827.648207:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404827.648232:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1784404827.648239:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784404827.652014:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784404827.652023:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1784404827.652039:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404827.652042:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784404827.652970:0:8482:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784404827.652976:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1784404827.652987:0:8482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784404827.653793:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784404827.653799:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1784404827.653823:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404827.653825:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784404827.654061:0:9907:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784404827.654064:0:9907:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1784404827.654072:0:9907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1784404827.661247:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd789ad 00000020:00000080:3.0:1784404827.661261:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd57b4e2000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784404827.664420:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57b4e2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1784404827.676896:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd789c2 00000020:00000080:3.0:1784404827.676911:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd57b4e4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1784404827.676931:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1784404827.676937:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404827.676946:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784404827.676950:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9dd573b019c0) has no exports 00000004:01000000:3.0:1784404827.677121:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784404827.677129:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78ccb 00000020:00000080:3.0:1784404827.677133:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd44254c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1784404827.677137:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1784404827.677141:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404827.677148:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784404827.677150:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9dd573a899c0) has no exports 00000020:00000080:3.0:1784404827.677156:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78cc4 00000020:00000080:3.0:1784404827.677159:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd442737000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1784404827.677396:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57b4e4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1784404827.677412:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1784404827.677417:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442737000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1784404827.685814:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784404827.685823:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784404827.685828:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1784404827.685837:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404827.685839:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784404827.685905:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404827.685919:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784404827.685929:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78b89 00000020:00000080:2.0:1784404827.685938:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd573b4e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784404827.685945:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784404827.685953:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404827.685957:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784404827.685961:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9dd574c14d40) has no exports 00000020:00000080:2.0:1784404827.685970:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78b82 00000020:00000080:2.0:1784404827.685974:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd57df4d800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1784404827.686737:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784404827.686742:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784404827.686744:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1784404827.686749:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404827.686750:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784404827.686784:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404827.686790:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1784404827.686802:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784404827.686809:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd789e5 00000020:00000080:2.0:1784404827.686814:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd573aad800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784404827.686819:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1784404827.686824:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404827.686828:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784404827.686830:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9dd5453e19c0) has no exports 00000020:00000080:2.0:1784404827.686836:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd789de 00000020:00000080:2.0:1784404827.686839:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd57c5d3000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1784404827.689419:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1784404827.689427:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784404827.689432:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1784404827.689440:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784404827.689478:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404827.689488:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784404827.689548:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404827.689552:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784404827.689557:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd573b48000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784404827.689562:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573b48000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1784404827.689572:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784404827.689744:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd789c9 00000020:00000080:3.0:1784404827.689751:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd57b4e0800/lustre-MDD0001_UUID 00000020:01000000:3.0:1784404827.689756:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1784404827.689760:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404827.690101:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784404827.690107:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9dd573b00000) has no exports 00000020:00000080:3.0:1784404827.690128:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404827.690133:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1784404827.690138:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd789d0 00000020:00000080:3.0:1784404827.690142:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd57b4e6000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1784404827.690151:0:15354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd565e88000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1784404827.690154:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd565e88000 2 00000020:01000004:3.0:1784404827.690157:0:15354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd565e88000 from lustre-MDT0001 00000020:00000080:3.0:1784404827.690174:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404827.690178:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1784404827.690180:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd57b4e5800/lustre-MDT0001_UUID 00000020:00000080:3.0:1784404827.690182:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57b4e5800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1784404827.690189:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1784404827.690222:0:15354:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1784404827.690226:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1784404827.690229:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404827.690233:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784404827.690241:0:15354:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9dd574c01800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784404827.690246:0:15354:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9dd574c119c0) has exports, disconnecting them 00000020:00080000:3.0:1784404827.690251:0:15354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9dd574c01800), last request at 1784404590 00000020:00000080:3.0:1784404827.690257:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78a24 00000020:00080000:3.0:1784404827.690276:0:15354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd574c01800): rc 0 00000020:00000080:3.0:1784404827.690280:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd574c01800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1784404827.690698:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442730800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784404827.690711:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd442731800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784404827.690714:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442731800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1784404827.690724:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404827.690784:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573b4e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784404827.690792:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57df4d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784404827.690797:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd57df4f800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784404827.690801:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd573b4d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784404827.690803:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573b4d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1784404827.690807:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404827.690834:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aad800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1784404827.690839:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57c5d3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784404827.690843:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd57c5d5800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1784404827.690848:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd56d230000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784404827.690872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd56d230000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1784404827.690876:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404827.690953:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57b4e0800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1784404827.690968:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd57b4e1800/lustre-MDD0001_UUID 00000020:00000080:1.0:1784404827.690970:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57b4e1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1784404827.690973:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1784404827.691198:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57b4e6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784404827.691207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574c01800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1784404827.701832:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1784404827.701840:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404827.701845:0:15354:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784404827.701875:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404827.701907:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574c00000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1784404827.702090:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404827.702100:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1784404827.702106:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd574c06800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1784404827.702110:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574c06800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1784404827.702117:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1784404827.702194:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd565e88000 1 00000020:00000080:1.0:1784404827.702200:0:15354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78960 00000020:00000080:1.0:1784404827.702207:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd573aa9000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1784404827.702215:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1784404827.702225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aa9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784404827.702236:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404827.702242:0:15354:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784404827.702245:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9dd573b04d40) has no exports 00000020:00000080:2.0:1784404828.036126:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404828.036143:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1784404828.036151:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd565e89800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1784404828.036156:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e89800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1784404828.036170:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1784404828.036316:0:15354:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd565e8a800 00000020:01000000:2.0:1784404828.036336:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1784404828.036340:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404828.036344:0:15354:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784404828.036347:0:15354:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9dd5453e0000) has no exports 00000100:00100000:2.0:1784404828.036464:0:9527:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9dd44273ac00:9527] 3 exiting: rc = 0 00000100:00100000:1.0:1784404828.037240:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9dd553cc6e00:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1784404828.043271:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9dd56d20b400:6521] 2 exiting: rc = 0 00000100:00100000:0.0:1784404828.043415:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9dd56d20b200:6520] 1 exiting: rc = 0 00000100:00100000:3.0:1784404828.050526:0:13543:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9dd443676a00:13543] 4 exiting: rc = 0 00000100:00100000:0.0:1784404828.050714:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050725:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050732:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050737:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050744:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050750:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050755:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050762:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050768:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050773:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050779:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050785:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050790:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050796:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050802:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050808:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050813:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050819:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050823:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050828:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050833:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050839:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050844:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050879:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050886:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050892:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050898:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050920:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050925:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050930:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050936:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050941:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050946:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050951:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050957:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050962:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050968:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050975:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050980:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050986:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050991:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.050995:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051001:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051006:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051012:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051016:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051022:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051028:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051033:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051038:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051043:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051048:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051054:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051060:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051065:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051071:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051077:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051083:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051088:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051094:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051100:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051106:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051131:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.051145:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1784404828.055933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404828.055943:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784404828.055960:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404828.055968:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1784404828.055974:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784404828.055981:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd573b4b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404828.056020:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cdd180 x1871083728956672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404828.056074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404828.056077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784404828.056079:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404828.056083:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1784404828.056085:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784404828.056089:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404828.056102:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cde680 x1871083728956928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784404828.056217:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728956800:0@lo:400:kworker.0 00000400:00000100:3.0:1784404828.056284:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728956800 offset 0 length 224: 4 00000100:00100000:3.0:1784404828.056437:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404828.056444:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728957056:0@lo:400:kworker.0 00000400:00000100:3.0:1784404828.056465:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728957056 offset 0 length 224: 4 00000100:00100000:2.0:1784404828.056581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728956672:0@lo:38:kworker.0 00000400:00000100:2.0:1784404828.056606:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728956672 offset 0 length 520: 4 00000100:00100000:2.0:1784404828.056624:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728956928:0@lo:38:kworker.0 00000400:00000100:2.0:1784404828.056640:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728956928 offset 0 length 520: 4 00000100:00100000:3.0:1784404828.059771:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9dd547dc8400:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1784404828.060162:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9dd56d405400:6522] 0 exiting: rc = 1 00000100:00100000:2.0:1784404828.060993:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061004:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061010:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061016:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061022:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061027:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061035:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061041:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061047:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061053:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061060:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061066:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061073:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061078:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061084:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061089:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061094:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061099:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061104:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061109:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061113:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061126:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061132:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061137:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061142:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061147:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061152:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061156:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061162:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061166:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061171:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061176:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061183:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061189:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061195:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061219:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061224:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061230:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061235:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061240:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061245:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061250:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061256:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061262:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061508:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061517:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061523:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061528:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061542:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061548:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061554:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061559:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061564:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061569:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061574:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061579:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061584:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061589:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061594:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061599:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061604:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061608:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061613:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.061618:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.062680:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9dd56d2cfe00:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1784404828.062836:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9dd56d2cf400:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1784404828.062949:0:14219:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9dd54850be00:14219] 2 exiting: rc = 0 00000100:00100000:2.0:1784404828.063394:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063403:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063423:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063429:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063435:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063455:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063461:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063467:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063473:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063480:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063498:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063506:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063512:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063519:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063524:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063530:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063550:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063556:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063561:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063568:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063574:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063581:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063604:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063611:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063619:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063625:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063632:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063638:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063644:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063650:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063656:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063662:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063668:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063673:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063694:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063702:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063707:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063713:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063719:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063726:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063739:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063746:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063753:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063759:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063766:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063773:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063794:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063803:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063809:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063816:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063823:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063828:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063834:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063839:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063845:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063872:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063880:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063886:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.063907:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.064373:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.064378:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.064384:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.064389:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.064403:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.086624:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9dd547dc8e00:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1784404828.089136:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9dd56d2ce000:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1784404828.090051:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090059:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090065:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090070:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090075:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090080:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090085:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090089:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090095:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090100:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090106:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090111:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090130:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090135:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090141:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090147:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090152:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090156:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090160:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090165:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090169:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090174:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090180:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090184:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090189:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090194:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090200:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090205:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090210:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090214:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090219:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090223:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090242:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090247:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090253:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090258:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090264:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090268:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090273:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090278:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090283:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090289:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090294:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090299:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090304:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090309:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090314:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090319:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090324:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090328:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090333:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090337:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090342:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090346:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090351:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090356:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090360:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090365:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090371:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090376:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090382:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090387:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090392:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090397:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.090805:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9dd56d2cee00:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1784404828.091001:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9dd56d2ce200:6529] 1 exiting: rc = 0 00000100:00100000:0.0:1784404828.091129:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091135:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091148:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091154:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091158:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091163:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091168:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091173:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091178:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091182:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091188:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091193:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091199:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091204:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091209:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091214:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091218:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091223:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091228:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091233:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091237:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091243:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091248:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091253:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091258:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091262:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091267:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091273:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091278:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091283:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091287:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091292:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091298:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091303:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091308:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091313:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091317:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091331:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091337:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091342:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091347:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091352:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091358:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091363:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091367:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091373:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091378:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091383:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091388:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091393:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091399:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091405:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091410:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091416:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091421:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091426:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091431:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091436:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091441:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091446:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091450:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091455:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091460:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091465:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.091845:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9dd5482ad200:6530] 0 exiting: rc = 1 00000100:00100000:3.0:1784404828.092126:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9dd5482ac400:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1784404828.092299:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092306:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092311:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092316:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092321:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092326:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092331:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092347:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092353:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092358:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092363:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092367:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092373:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092379:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092383:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092388:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092393:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092398:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092403:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092408:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092413:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092418:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092424:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092428:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092433:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092437:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092442:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092447:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092452:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092457:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092461:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092466:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092469:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092474:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092479:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092483:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092488:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092493:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092498:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092502:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092507:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092512:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092525:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092530:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092545:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092550:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092556:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092561:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092565:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092571:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092576:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092581:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092585:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092590:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092595:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092600:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092605:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092611:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092616:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092621:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092627:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092632:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092637:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404828.092642:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.095262:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9dd56d2e8400:6533] 1 exiting: rc = 0 00000100:00100000:2.0:1784404828.095462:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9dd56d2e9200:6532] 0 exiting: rc = 1 00000100:00100000:0.0:1784404828.096043:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9dd56d2e9a00:6534] 2 exiting: rc = 0 00000100:00100000:2.0:1784404828.100940:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.100954:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.100963:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.100968:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.100973:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.100979:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.100984:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.100989:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101016:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101022:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101029:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101034:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101039:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101045:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101050:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101055:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101060:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101067:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101074:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101080:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101086:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101093:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101099:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101105:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101111:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101131:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101156:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101164:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101170:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101176:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101184:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101189:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101195:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101202:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101209:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101215:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101221:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101227:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101234:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101240:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101249:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101255:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.101261:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102256:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102261:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102266:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102370:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102376:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102382:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102388:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102420:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102426:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102432:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102438:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102444:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102450:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102455:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102461:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102467:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102473:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102479:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102484:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102489:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404828.102495:0:15354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784404828.116085:0:15354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404828.116102:0:15354:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1784404828.116108:0:15354:0:(genops.c:885:class_export_put()) final put ffff9dd544dfa000/MDS_uuid 00000020:00000080:2.0:1784404828.116113:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd544dfa000/MDS_uuid for MDS 00000020:01000000:2.0:1784404828.116205:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1784404828.116515:0:15354:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1784404828.420986:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404829.443824:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404830.473988:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404831.492114:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784404832.334594:0:15554:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784404832.352211:0:15554:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1784404832.352277:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404832.352295:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404832.352303:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404832.352311:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404832.353901:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784404832.353915:0:15554:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784404832.353957:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784404832.353970:0:15554:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443cdd180 x1871083728956672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404832.354005:0:15554:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784404832.354023:0:15554:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784404832.354029:0:15554:0:(import.c:65:import_set_state_nolock()) ffff9dd573b4b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1784404832.354035:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784404832.354039:0:15554:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443cdd180 x1871083728956672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404853 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404832.354046:0:15554:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784404832.354050:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 28s for inflight to error out 00000100:00100000:3.0:1784404832.354117:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728956672:0@lo:38:kworker.0 00010000:00010000:0.0:1784404832.354368:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404832.354376:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404832.354386:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151aa00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404832.354389:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404832.354399:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404832.354417:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404832.354423:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784404832.354425:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784404832.354428:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784404832.354443:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:0.0:1784404832.354446:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404832.354452:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151aa00/0x24b3e2e6dcd78d9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78da4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404832.354463:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404832.354465:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404832.354467:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784404832.355908:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784404832.355924:0:15554:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443cdce00 x1871083728956800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404832.355950:0:15554:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784404832.355956:0:15554:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784404832.355980:0:15554:0:(import.c:65:import_set_state_nolock()) ffff9dd57df4b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784404832.356034:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083728957184:0@lo:39:umount.0 00000400:00000100:3.0:1784404832.356093:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728957184 offset 0 length 224: 4 00000100:00100000:0.0:1784404832.357161:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728956800:0@lo:400:kworker.0 00010000:00010000:2.0:1784404832.515675:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404833.155033:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404833.155045:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784404833.155049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404833.155052:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784404833.155200:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404833.155225:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728957312:0@lo:400:kworker.0 00000400:00000100:2.0:1784404833.155291:0:3649:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728957312 offset 0 length 224: 4 00000001:00100000:3.0:1784404833.163819:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784404833.163830:0:9511:0:(genops.c:885:class_export_put()) final put ffff9dd44319a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784404833.164061:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44319a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784404833.164109:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd44319f800 for lustre-OST0001 00000001:00100000:1.0:1784404833.167701:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784404833.167711:0:8427:0:(genops.c:885:class_export_put()) final put ffff9dd574d7f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784404833.168145:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d7f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784404833.168503:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574d7a000 for lustre-OST0000 00010000:00010000:2.0:1784404833.539202:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404834.563740:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404835.587111:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404836.611718:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404837.507135:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404827/real 1784404827] req@ffff9dd443632a00 x1871083728956544/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784404837 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404837.507170:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd443632a00 x1871083728956544/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784404837 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784404837.507209:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd56cf4f000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404837.507240:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784404837.507244:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3645:1871083728956544:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1784404837.507322:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404837.507328:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784404837.507331:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd56cf4f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404837.507337:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 445 00000100:00080000:0.0:1784404837.507343:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784404837.507350:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff9dd56cf4f000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404837.507383:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443633800 x1871083728957440/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784404837.507421:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404837.507431:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784404837.507549:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404837.507565:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728957568:0@lo:400:kworker.0 00000400:00000100:1.0:1784404837.507638:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728957568 offset 0 length 224: 4 00000100:00100000:3.0:1784404837.507798:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3645:1871083728957440:0@lo:250:kworker.0 00000400:00000100:3.0:1784404837.507820:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871083728957440 offset 0 length 520: 4 00010000:00010000:0.0:1784404837.635268:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404838.659149:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404839.684721:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404840.707213:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404841.731452:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404842.627711:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404832/real 1784404832] req@ffff9dd443d19c00 x1871083728957184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404842 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404842.627747:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd443d19c00 x1871083728957184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404842 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784404842.627769:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57df4b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784404842.627791:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083728957184:0@lo:39:umount.0 00000100:00080000:3.0:1784404842.627846:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784404842.627869:0:15554:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784404842.627874:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784404842.628778:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404842.628792:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404842.628799:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404842.628806:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404842.631636:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784404842.631659:0:15554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404842.631673:0:15554:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404842.631706:0:15554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404842.631713:0:15554:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634006:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404842.634021:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634033:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dae00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404842.634037:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634047:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404842.634054:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404842.634059:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784404842.634062:0:10394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1784404842.634076:0:10394:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:2.0:1784404842.634080:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634087:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821dae00/0x24b3e2e6dcd78dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78db2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634123:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404842.634127:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634132:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404842.634135:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634141:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404842.634148:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404842.634153:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784404842.634155:0:10394:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1784404842.634158:0:10394:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:2.0:1784404842.634161:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404842.634168:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404842.634169:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404842.634171:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404842.634878:0:15554:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784404842.634888:0:15554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd540031e00/0x24b3e2e6dcd79021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd79028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404842.634901:0:15554:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1784404842.634908:0:15554:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1784404842.634910:0:15554:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1784404842.634944:0:15554:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1784404842.634949:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1784404842.634957:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404842.634962:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784404842.634966:0:15554:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9dd570464d40) has no exports 00000020:00080000:3.0:1784404842.634988:0:15554:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9dd570464d40) has no exports 00010000:00010000:0.0:1784404842.636580:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784404842.639443:0:15554:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd4433dc3c0 - data ffff9dd560323948/ffff9dd574daec00 00000020:01000000:3.0:1784404842.639588:0:15554:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd551fc5a80 - data ffff9dd5662bd510/ffff9dd57df43800 00100000:10000000:3.0:1784404842.647657:0:15554:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784404842.679696:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78afd 00000020:00000080:2.0:1784404842.679722:0:15554:0:(genops.c:885:class_export_put()) final put ffff9dd565e3d800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1784404842.679743:0:15554:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd574d3a800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1784404842.679747:0:15554:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd574d3a800 2 00000020:01000004:2.0:1784404842.679750:0:15554:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd574d3a800 from lustre-OST0000 00000020:00000080:2.0:1784404842.679775:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404842.679797:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1784404842.679801:0:15554:0:(genops.c:885:class_export_put()) final put ffff9dd565e39800/lustre-OST0000_UUID 00000020:00000080:2.0:1784404842.679804:0:15554:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e39800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1784404842.679810:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1784404842.679900:0:15554:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1784404842.679905:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784404842.679909:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404842.679914:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784404842.679922:0:15554:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dd574d7a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404842.679928:0:15554:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9dd44213cd40) has exports, disconnecting them 00000020:00080000:2.0:1784404842.679933:0:15554:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dd574d7a800), last request at 1784404607 00000020:00000080:2.0:1784404842.679938:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78b27 00000020:00080000:2.0:1784404842.679948:0:15554:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd574d7a800): rc 0 00000020:00000080:2.0:1784404842.679954:0:15554:0:(genops.c:885:class_export_put()) final put ffff9dd574d7a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784404842.681018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd565e3d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784404842.681035:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d7a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1784404842.682225:0:15554:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1784404842.682234:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784404842.682239:0:15554:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784404842.682245:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784404842.682392:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404842.682400:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1784404842.682417:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784404842.682432:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404842.682437:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784404842.682444:0:15554:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9dd574d7c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784404842.682450:0:15554:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9dd574c10000) has exports, disconnecting them 00000020:00080000:3.0:1784404842.682455:0:15554:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9dd574d7c000), last request at 1784404607 00000020:00000080:3.0:1784404842.682466:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78b3c 00000020:00080000:3.0:1784404842.682483:0:15554:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd574d7c000): rc 0 00000020:00000080:3.0:1784404842.682488:0:15554:0:(genops.c:885:class_export_put()) final put ffff9dd574d7c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784404842.683414:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd573b4b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784404842.683423:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd574d7b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784404842.683427:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d7b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784404842.683438:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784404842.683528:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d7c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1784404842.704977:0:15554:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784404842.704986:0:15554:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784404842.704990:0:15554:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784404842.704997:0:15554:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784404842.705024:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd57df4b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784404842.705188:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404842.705198:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1784404842.705203:0:15554:0:(genops.c:885:class_export_put()) final put ffff9dd574d78000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1784404842.705208:0:15554:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d78000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1784404842.705217:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1784404842.705283:0:15554:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd574d3a800 1 00000020:00000080:0.0:1784404842.705298:0:15554:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78ac5 00000020:00000080:0.0:1784404842.705304:0:15554:0:(genops.c:885:class_export_put()) final put ffff9dd57395b800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784404842.705313:0:15554:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784404842.705321:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57395b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784404842.705330:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404842.705334:0:15554:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784404842.705337:0:15554:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9dd574c13380) has no exports 00010000:00010000:2.0:1784404842.772224:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784404842.814797:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404842.814811:0:15554:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1784404842.814817:0:15554:0:(genops.c:885:class_export_put()) final put ffff9dd574d38000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1784404842.814822:0:15554:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d38000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1784404842.814832:0:15554:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1784404842.815024:0:15554:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd574d39800 00000020:02000400:3.0:1784404842.815069:0:15554:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1784404842.894821:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784404842.894829:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404842.894832:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784404842.894835:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784404842.895031:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728957696:0@lo:400:kworker.0 00000400:00000100:0.0:1784404842.895086:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728957696 offset 0 length 224: 4 00010000:00010000:2.0:1784404843.782008:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404844.803119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1784404844.932377:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404828/real 1784404828] req@ffff9dd443cdfb80 x1871083728957056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404844.960458:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dd443cdfb80 x1871083728957056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404844 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784404844.960474:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9dd44333a800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784404844.960483:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784404844.971417:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1784404844.971519:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404844.971525:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404844.971528:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404844.971532:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404844.971534:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404844.971537:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784404844.971541:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd44333a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404844.971548:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 244 00000100:00080000:2.0:1784404844.971557:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd44333a800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404844.971600:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ffb480 x1871083728957824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404844.971664:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728957056:0@lo:400:kworker.0 00000100:00100000:3.0:1784404844.971724:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083728957824:0@lo:38:kworker.0 00000400:00000100:3.0:1784404844.971773:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083728957824 offset 0 length 520: 4 00010000:00010000:0.0:1784404845.838920:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784404846.570315:0:15756:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784404846.591304:0:15756:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784404846.591404:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404846.591420:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404846.591503:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404846.591511:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404846.591531:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784404846.591537:0:15756:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1784404846.591547:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404846.591558:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784404846.591565:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1784404846.591568:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dbc00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404846.591574:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.591583:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404846.591591:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404846.591597:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784404846.591599:0:10394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784404846.591602:0:10394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784404846.591617:0:10394:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:2.0:1784404846.591621:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.591628:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd5821dbc00/0x24b3e2e6dcd78d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78d88 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.591640:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404846.591642:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404846.591643:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404846.591648:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443cde680 x1871083728956928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404846.591773:0:15756:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784404846.591780:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784404846.591787:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784404846.591792:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404846.591797:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443cde680 x1871083728956928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404853 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404846.591805:0:15756:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784404846.592064:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1784404846.592067:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728956928:0@lo:38:kworker.0 00000100:00080000:0.0:1784404846.594419:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784404846.594489:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443cdea00 x1871083728957312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404849 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404846.594551:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443632300 x1871083728957568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404846.594566:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443d18e00 x1871083728957696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404858 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404846.594663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083728957312:0@lo:400:kworker.0 00000100:00100000:0.0:1784404846.595518:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd577ffb480 x1871083728957824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404854 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404846.595538:0:15756:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784404846.595545:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784404846.595718:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728957568:0@lo:400:kworker.0 00000100:00080000:0.0:1784404846.595814:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9dd44333a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1784404846.595821:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784404846.595827:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443d18e00 x1871083728957696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404858 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404846.603013:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083728957696:0@lo:400:kworker.0 00000100:00100000:0.0:1784404846.603244:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd577ffb480 x1871083728957824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404854 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404846.603257:0:15756:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784404846.606591:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083728957824:0@lo:38:kworker.0 00000100:00100000:0.0:1784404846.607147:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784404846.608763:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608781:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608788:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608795:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608818:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404846.608824:0:15756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608831:0:15756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608838:0:15756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608844:0:15756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.608871:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404846.608881:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.608890:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404846.608895:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.608905:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404846.608913:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404846.608920:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784404846.608923:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1784404846.608935:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:2.0:1784404846.608939:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.608946:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443548e00/0x24b3e2e6dcd78d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78d96 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.608963:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404846.608967:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404846.608973:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404846.608990:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.608996:0:15756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784404846.608999:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404846.609003:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1784404846.609009:0:15756:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 10000000:00010000:2.0:1784404846.609010:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404846.609018:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784404846.609020:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784404846.609023:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784404846.609032:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:2.0:1784404846.609034:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784404846.609038:0:15756:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:2.0:1784404846.609044:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd79013 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7901a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1784404846.609044:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1784404846.609057:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1784404846.609058:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404846.609062:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784404846.609063:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784404846.609068:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9dd5704619c0) has no exports 00000020:00080000:0.0:1784404846.609098:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9dd5704619c0) has no exports 00010000:00010000:1.0:1784404846.609491:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784404846.612533:0:15756:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5624f1540 - data ffff9dd566366438/ffff9dd574e36400 00000020:01000000:1.0:1784404846.612826:0:15756:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd44251e780 - data ffff9dd566280a20/ffff9dd443334c00 00010000:00010000:2.0:1784404846.613597:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1784404846.640667:0:15756:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784404846.656992:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78c23 00000020:00000080:0.0:1784404846.657005:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd44254b800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1784404846.657034:0:15756:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd442280800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1784404846.657039:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442280800 2 00000020:01000004:0.0:1784404846.657042:0:15756:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd442280800 from lustre-OST0001 00000020:00000080:0.0:1784404846.657068:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404846.657078:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1784404846.657081:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd442549800/lustre-OST0001_UUID 00000020:00000080:0.0:1784404846.657084:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442549800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1784404846.657092:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1784404846.657191:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1784404846.657220:0:15756:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3->MGS 00010000:00010000:0.0:1784404846.657238:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd56d209c00/0x24b3e2e6dcd7897c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78983 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404846.657251:0:15756:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd56d209c00/0x24b3e2e6dcd7897c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78983 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404846.657258:0:15756:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1784404846.657261:0:15756:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1784404846.657264:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1784404846.657279:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:0.0:1784404846.657283:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd56d209c00/0x24b3e2e6dcd7897c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78983 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404846.657298:0:15756:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd78df8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404846.657306:0:15756:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd78df8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404846.657321:0:15756:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784404846.657324:0:15756:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1784404846.657326:0:15756:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1784404846.657337:0:15756:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd56cf4f000 00010000:00010000:0.0:1784404846.657340:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151b600/0x24b3e2e6dcd78df1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd78df8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784404846.657357:0:15756:0:(import.c:65:import_set_state_nolock()) ffff9dd56cf4f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1784404846.657362:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784404846.657364:0:15756:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784404846.657365:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784404846.657388:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784404846.657399:0:15756:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd443633800 x1871083728957440/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784404852 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784404846.657419:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784404846.657422:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1784404846.657653:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4364c714-0ef8-4a4f-a8e5-bb2917aa36f3:3645:1871083728957440:0@lo:250:kworker.0 10000000:01000000:0.0:1784404846.657709:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784404846.657717:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78879 00000020:00000080:0.0:1784404846.657722:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd544dfd800/4364c714-0ef8-4a4f-a8e5-bb2917aa36f3 00000020:01000000:0.0:1784404846.657739:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.142@tcp (flags='') 00000020:00000080:0.0:1784404846.657745:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404846.657749:0:15756:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784404846.657753:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9dd545b94d40) has no exports 00000020:00000080:2.0:1784404846.657764:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd544dfd800/4364c714-0ef8-4a4f-a8e5-bb2917aa36f3 for MGC192.168.202.142@tcp 10000000:01000000:3.0:1784404846.657829:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1784404846.657946:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.142@tcp: client import never connected 00000100:00080000:0.0:1784404846.657950:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1784404846.657952:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784404846.657954:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1784404846.657956:0:15756:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784404846.657989:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404846.657994:0:15756:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.142@tcp (uuid 4364c714-0ef8-4a4f-a8e5-bb2917aa36f3) 00000020:01000000:0.0:1784404846.658001:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784404846.658010:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404846.658014:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784404846.658018:0:15756:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9dd443199000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784404846.658023:0:15756:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9dd44213b380) has exports, disconnecting them 00000020:00080000:0.0:1784404846.658028:0:15756:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9dd443199000), last request at 1784404626 00000020:00000080:0.0:1784404846.658032:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78c4d 00000020:00000080:2.0:1784404846.658041:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd56cf4f000 for MGC192.168.202.142@tcp 00000020:00080000:0.0:1784404846.658044:0:15756:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd443199000): rc 0 00000020:00000080:0.0:1784404846.658050:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd443199000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784404846.658051:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd56cf48800/4364c714-0ef8-4a4f-a8e5-bb2917aa36f3 00000020:00000080:2.0:1784404846.658055:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd56cf48800/4364c714-0ef8-4a4f-a8e5-bb2917aa36f3 for MGC192.168.202.142@tcp 00000020:01000000:2.0:1784404846.658061:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.142@tcp (4364c714-0ef8-4a4f-a8e5-bb2917aa36f3) 00000020:00000080:2.0:1784404846.658466:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443199000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1784404846.671944:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784404846.671953:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404846.671958:0:15756:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784404846.671966:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784404846.672168:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404846.672178:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1784404846.672186:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784404846.672194:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404846.672199:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784404846.672207:0:15756:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9dd44333b800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404846.672213:0:15756:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9dd573b1cd40) has exports, disconnecting them 00000020:00080000:2.0:1784404846.672217:0:15756:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9dd44333b800), last request at 1784404626 00000020:00000080:2.0:1784404846.672221:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78c62 00000020:00080000:2.0:1784404846.672239:0:15756:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd44333b800): rc 0 00000020:00000080:2.0:1784404846.672245:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd44333b800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1784404846.672647:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd44319c800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784404846.672655:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd44319d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1784404846.672658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44319d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1784404846.672671:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1784404846.672742:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44333b800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1784404846.696680:0:15756:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784404846.696691:0:15756:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784404846.696695:0:15756:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784404846.696704:0:15756:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784404846.696776:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1784404846.696968:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd44333a800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1784404846.706958:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1784404846.707264:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1784404846.707383:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9dd545294400:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1784404846.707687:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9dd56d2e2800:6502] 0 exiting: rc = 1 00000100:00100000:2.0:1784404846.707880:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.708261:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9dd56d26ce00:6506] 2 exiting: rc = 0 00000100:00100000:2.0:1784404846.708264:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9dd56d2e3000:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1784404846.710050:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9dd56d26d600:6505] 1 exiting: rc = 0 00000100:00100000:3.0:1784404846.710061:0:10336:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9dd573a74400:10336] 3 exiting: rc = 0 00000100:00100000:2.0:1784404846.712759:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712771:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712777:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712784:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712810:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712816:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712821:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712828:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712834:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712840:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712845:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712868:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712874:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712879:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712885:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712890:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712895:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712901:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712907:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712913:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712920:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712924:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712929:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712934:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712940:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712944:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712948:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712953:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712958:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712963:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712968:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712973:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712978:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712983:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712988:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712992:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.712998:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713003:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713007:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713020:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713025:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713030:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713034:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713039:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713044:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713049:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713055:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713060:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713065:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713070:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713075:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713080:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713084:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713089:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713094:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713099:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713105:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713110:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713115:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713120:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713124:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713130:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713135:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.713139:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784404846.715100:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404846.715110:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1784404846.715501:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd577f03000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1784404846.715507:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd577f03000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1784404846.715513:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1784404846.715559:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442280800 1 00000020:00000080:2.0:1784404846.715565:0:15756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd78bf2 00000020:00000080:2.0:1784404846.715571:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd57395c000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1784404846.715582:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1784404846.715606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57395c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1784404846.715620:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404846.715625:0:15756:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784404846.715646:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9dd4421399c0) has no exports 00000020:00000080:0.0:1784404846.812247:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404846.812260:0:15756:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1784404846.812265:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd442282000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1784404846.812269:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442282000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1784404846.812276:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1784404846.812865:0:15756:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd442284800 00000020:01000000:0.0:1784404846.812885:0:15756:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1784404846.812888:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404846.812891:0:15756:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784404846.812894:0:15756:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9dd573a8cd40) has no exports 00000020:00000080:0.0:1784404846.812909:0:15756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404846.812913:0:15756:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1784404846.812915:0:15756:0:(genops.c:885:class_export_put()) final put ffff9dd573959000/OSS_uuid 00000020:00000080:0.0:1784404846.812917:0:15756:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573959000/OSS_uuid for OSS 00000020:01000000:0.0:1784404846.812920:0:15756:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1784404846.812980:0:8488:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9dd44227ca00:8488] 3 exiting: rc = 0 00000100:00100000:0.0:1784404846.813048:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9dd56cf20200:8434] 2 exiting: rc = 0 00000100:00100000:3.0:1784404846.814278:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9dd573a36200:8431] 0 exiting: rc = 1 00000100:00080000:3.0:1784404846.814451:0:6515:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1784404846.814627:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9dd56cf21c00:8433] 1 exiting: rc = 0 00000100:00100000:0.0:1784404846.817222:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817233:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817253:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817280:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817286:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817292:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817297:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817302:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817309:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817638:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817646:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817651:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817656:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817662:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817667:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817672:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817678:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817683:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817688:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817693:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817698:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817702:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817707:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817712:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817718:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817722:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817727:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817733:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817738:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817743:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817749:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817755:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817761:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817767:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817772:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817779:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817785:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817791:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817806:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817812:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817818:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817824:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817830:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817835:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817841:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.817847:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818454:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818460:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818464:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818469:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818473:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818478:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818483:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818487:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818493:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818498:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818504:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818510:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818515:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818520:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818525:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818530:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818535:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.818550:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.825146:0:10095:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9dd4424c4000:10095] 2 exiting: rc = 0 00000100:00100000:1.0:1784404846.827757:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9dd573a9b400:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1784404846.829527:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9dd574cb5400:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1784404846.829690:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829706:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829714:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829720:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829725:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829730:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829734:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829739:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829745:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829751:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829756:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829762:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829768:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829773:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829778:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829783:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829788:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829793:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829798:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829803:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829808:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829829:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829834:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829839:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829845:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829882:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829888:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829894:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829899:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829904:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829910:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829915:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829920:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829925:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829930:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829934:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829938:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829943:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829947:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829952:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829957:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829963:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829968:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829973:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829978:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829983:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829987:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829992:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.829996:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830001:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830005:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830010:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830014:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830019:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830023:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830028:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830040:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830047:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830053:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830058:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830062:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830072:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830079:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830088:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.830929:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9dd57b4cac00:8438] 1 exiting: rc = 0 00000100:00100000:1.0:1784404846.831088:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9dd574c9e800:8439] 2 exiting: rc = 0 00000100:00100000:2.0:1784404846.842650:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9dd57c7d6600:8437] 0 exiting: rc = 1 00000100:00100000:2.0:1784404846.846710:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846721:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846727:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846732:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846741:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846748:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846753:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846760:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846766:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846774:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846781:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846790:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846796:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846802:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846807:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846812:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846818:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846827:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846833:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846839:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846845:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846865:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.846878:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848497:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848533:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848540:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848547:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848553:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848558:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848580:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848586:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848593:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848599:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848605:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848610:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848616:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848622:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848627:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848632:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848638:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848645:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848650:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848658:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848664:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848670:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848676:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848682:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848687:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848707:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848714:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848720:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848726:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848733:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848739:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848744:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848750:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848758:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848763:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848769:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848776:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848782:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848788:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848794:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404846.848800:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404846.870396:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9dd545b69e00:8440] 0 exiting: rc = 1 00000100:00100000:2.0:1784404846.871260:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9dd545b69c00:8441] 1 exiting: rc = 0 00000100:00100000:3.0:1784404846.873623:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873634:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873639:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873644:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873649:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873655:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873660:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873665:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873670:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873675:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873680:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873684:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873690:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873695:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873719:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873725:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873730:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873736:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873751:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873756:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873760:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873765:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873770:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873775:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873780:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873785:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873790:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873796:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873801:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873806:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873811:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873816:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873821:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873826:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873831:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873836:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873841:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873846:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873867:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873873:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873878:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873884:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873888:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873894:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873901:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873907:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873915:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873921:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873926:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873941:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873946:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873952:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873957:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873971:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873981:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873992:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.873999:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.874004:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.874010:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.874015:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.874021:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.874027:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.874032:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.874038:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404846.874875:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9dd545b68e00:8443] 1 exiting: rc = 0 00000100:00100000:2.0:1784404846.875311:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9dd545b68200:8442] 0 exiting: rc = 1 00000100:00100000:3.0:1784404846.878582:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878609:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878619:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878626:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878633:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878642:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878669:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878677:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878683:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878688:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878694:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878700:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878706:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878712:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878719:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878725:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878731:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878737:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878756:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878762:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878783:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878789:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878795:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878801:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878806:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878812:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878818:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878824:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878829:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878835:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878901:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878911:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878919:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878928:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878936:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878944:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878952:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878961:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878973:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878984:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878989:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.878998:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879084:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879092:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879098:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879104:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879110:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879115:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879121:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879127:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879132:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879138:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879144:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879150:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879168:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879181:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879187:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879194:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879200:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879206:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879212:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879217:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879223:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784404846.879235:0:15756:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1784404846.904218:0:15756:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1784404866.335999:0:16533:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784404877.489536:0:17133:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784404877.489543:0:17133:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784404877.489545:0:17133:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784404877.489665:0:17133:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd443e83000 00000020:01000004:2.0:1784404877.489684:0:17133:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784404877.489693:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784404877.489709:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dd573b1cd40) 00000020:00000080:2.0:1784404877.489723:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784404877.587277:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784404877.588422:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.589347:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784404877.591767:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.592165:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.592439:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.592638:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.592973:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.593334:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.593522:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.593748:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.594065:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.594358:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.594591:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.594775:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.595149:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.595474:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.595665:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.595961:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.596255:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.596490:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.596713:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.597026:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.597331:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.597525:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.599042:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.599513:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.599714:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.599997:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.601224:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.601599:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.601975:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.602287:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.602577:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784404877.602928:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784404877.606625:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784404877.607502:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784404877.607774:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784404877.608115:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784404877.608409:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784404877.608613:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784404877.609037:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784404877.613377:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784404877.614527:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784404877.614893:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784404877.615350:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1784404877.615644:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784404877.619706:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784404877.620415:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784404877.620613:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784404877.621292:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1784404877.621528:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784404877.621745:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1784404877.622794:0:17133:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784404877.624298:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784404877.624309:0:17133:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784404877.624324:0:17133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79e36 00000020:01000004:3.0:1784404877.624334:0:17133:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784404877.624341:0:17133:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784404877.624347:0:17133:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd443e83000 from MGS 00000020:01000004:3.0:1784404877.624351:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784404877.624367:0:17133:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dd570463380) 00000020:00000080:3.0:1784404877.624379:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784404877.624448:0:17133:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd443e83000 from MGS, refs=2 00080000:01000000:3.0:1784404877.624453:0:17133:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784404877.624484:0:17133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79e44 00000100:00100000:3.0:1784404877.624588:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784404877.624706:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784404877.624713:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784404877.627059:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784404877.627075:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784404877.627770:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784404877.628472:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784404877.628479:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784404877.629403:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784404877.629412:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784404877.629741:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784404877.629747:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784404877.631248:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404877.631252:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404877.631254:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404877.631595:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404877.631598:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404877.631600:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404877.632402:0:17133:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1784404877.634601:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784404877.639728:0:17133:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784404877.640766:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784404877.640820:0:17133:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784404877.641021:0:17133:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784404877.641828:0:17133:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784404877.642506:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784404877.643141:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784404877.643148:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784404877.644274:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784404877.644284:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784404877.652763:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784404877.653833:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784404877.657039:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784404877.657064:0:17133:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.142@tcp' 00000020:01000004:2.0:1784404877.657066:0:17133:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784404877.657109:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.142@tcp (typ=mgc) 00000020:00000080:2.0:1784404877.657123:0:17133:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.142@tcp (ffff9dd573b199c0) 00000020:00000080:2.0:1784404877.657141:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784404877.657230:0:17133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd443e84800@MGC192.168.202.142@tcp: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404877.657384:0:17133:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.142@tcp-0 is initialized 00000040:01000000:2.0:1784404877.657390:0:17133:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 1 is initialized 00000100:00080000:1.0:1784404877.659494:0:17150:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1784404877.662319:0:17151:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784404877.665521:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.142@tcp (uuid fccb8c6c-dea6-48fe-a863-d61ae2c1427e) 00000020:00000080:2.0:1784404877.665554:0:17133:0:(genops.c:1385:class_connect()) connect: client fccb8c6c-dea6-48fe-a863-d61ae2c1427e, cookie 0x24b3e2e6dcd79e52 00000100:00080000:2.0:1784404877.665566:0:17133:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404877.665572:0:17133:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff9dd443e84800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404877.665603:0:17133:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ffb800 x1871083728957952/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404877.665653:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3645:1871083728957952:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784404877.665720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784404877.665780:0:17133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS 00000020:01000004:2.0:1784404877.665810:0:17133:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784404877.665828:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784404877.665841:0:17133:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9dd573b1b380) 00000020:00000080:2.0:1784404877.665869:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784404877.670660:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728957952 00000100:00100000:0.0:1784404877.670676:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728957952 00000100:00100000:0.0:1784404877.670719:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404877.670729:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1871083728957952:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784404877.670766:0:17146:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fccb8c6c-dea6-48fe-a863-d61ae2c1427e@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1784404877.673149:0:17146:0:(genops.c:1385:class_connect()) connect: client fccb8c6c-dea6-48fe-a863-d61ae2c1427e, cookie 0x24b3e2e6dcd79e60 00000100:00080000:0.0:1784404877.673307:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9dd549487800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404877.673409:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+5:3645:x1871083728957952:12345-0@lo:250:mount.lustre.0 Request processed in 2679us (7686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404877.673419:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404877.673496:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784404877.673505:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.142@tcp: connect to target with instance 0 00000100:00080000:0.0:1784404877.673512:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784404877.673516:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784404877.673519:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443e84800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784404877.673522:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784404877.673529:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784404877.673534:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3645:1871083728957952:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784404877.684592:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404877.684870:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1784404877.684880:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784404877.691033:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784404877.691045:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784404877.691721:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784404877.691728:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784404877.693054:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404877.693254:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784404877.693260:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784404877.693736:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784404877.693743:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784404877.758979:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784404877.759212:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784404877.759220:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784404877.760630:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784404877.760642:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784404877.774206:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404877.774380:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784404877.774386:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784404877.775239:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784404877.775248:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784404877.775758:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784404877.775956:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784404877.775961:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784404877.778220:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784404877.778233:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784404877.778895:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784404877.779070:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784404877.779075:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784404877.779729:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784404877.779736:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1784404877.829714:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784404877.830551:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784404877.830560:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1784404877.834987:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784404877.835008:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784404877.838632:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784404877.838648:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1784404877.843069:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1784404877.843118:0:17133:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784404877.843127:0:17133:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784404877.843260:0:17133:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784404877.843310:0:17133:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784404877.843319:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784404877.843321:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784404877.843322:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784404877.843323:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784404877.843325:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784404877.843326:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784404877.843327:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784404877.843328:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784404877.843329:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784404877.843331:0:17133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784404877.843333:0:17133:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784404877.843335:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784404877.843336:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784404877.843337:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784404877.843338:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784404877.843339:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784404877.843340:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784404877.843341:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784404877.843342:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784404877.843343:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784404877.843344:0:17133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784404877.843373:0:17133:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784404877.843398:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784404877.843494:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404877.846137:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958080 00000100:00100000:1.0:1784404877.846160:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958080 00000100:00100000:1.0:1784404877.846236:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404877.846248:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+5:17133:x1871083728958080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784404877.846335:0:17149:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784404877.846339:0:17149:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784404877.846342:0:17149:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:0.0:1784404877.846779:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165840 going to sleep for 11 seconds 10000000:01000000:2.0:1784404877.852973:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784404877.854145:0:17149:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1784404877.869802:0:17170:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784404877.869815:0:17170:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784404877.869819:0:17170:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784404877.869822:0:17170:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784404877.872046:0:17170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1784404877.882185:0:17149:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784404877.882202:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784404877.905283:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+5:17133:x1871083728958080:12345-0@lo:253:mount.lustre.0 Request processed in 59025us (61777us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404877.905299:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784404877.905434:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784404877.905450:0:17133:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784404877.905454:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784404877.905456:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784404877.905457:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404877.905458:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404877.905460:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404877.905461:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404877.905462:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404877.905464:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784404877.905467:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404877.905468:0:17133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784404877.905492:0:17133:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd443e83000 from lustre-MDT0000 10000000:01000000:2.0:1784404877.905549:0:17133:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784404877.905552:0:17133:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784404877.905556:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dd573b199c0 10000000:01000000:2.0:1784404877.905560:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784404877.905568:0:17133:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd573b199c0 from 1 10000000:01000000:2.0:1784404877.905571:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784404877.905613:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404877.905628:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404877.905640:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404877.905662:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784404877.905700:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404877.905771:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404877.909218:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958208 00000100:00100000:0.0:1784404877.909236:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958208 00000100:00100000:0.0:1784404877.909316:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784404877.909328:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+5:17133:x1871083728958208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404877.909348:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404877.909388:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b000/0x24b3e2e6dcd79e6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79e67 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404877.909417:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b000/0x24b3e2e6dcd79e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e67 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404877.909428:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b000/0x24b3e2e6dcd79e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e67 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404877.909437:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b000, rc 0) 00000100:00100000:0.0:1784404877.909535:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+6:17133:x1871083728958208:12345-0@lo:101:mount.lustre.0 Request processed in 209us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404877.909541:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404877.910024:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404877.910045:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.910055:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404877.910162:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404877.910207:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404877.910256:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5453133c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404877.910340:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958336 00000100:00100000:2.0:1784404877.910346:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958336 00000100:00100000:2.0:1784404877.910390:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784404877.910400:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+6:17133:x1871083728958336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404877.910506:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+6:17133:x1871083728958336:12345-0@lo:501:mount.lustre.0 Request processed in 108us (298us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784404877.910513:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404877.910626:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958336:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784404877.910654:0:17133:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784404877.910675:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.910684:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404877.910696:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd443e83000 10000000:01000000:1.0:1784404877.910701:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784404877.910706:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd443e83000 10000000:01000000:1.0:1784404877.910708:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784404877.910711:0:17133:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dd443e83000 from 1 10000000:01000000:1.0:1784404877.910713:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784404877.910760:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.910769:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.910777:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404877.910802:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784404877.910829:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404877.910884:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5453133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404877.910960:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958464 00000100:00100000:3.0:1784404877.910964:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958464 00000100:00100000:3.0:1784404877.910989:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784404877.910996:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+6:17133:x1871083728958464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404877.911005:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404877.911018:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c6e00/0x24b3e2e6dcd79e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79e75 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404877.911048:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c6e00/0x24b3e2e6dcd79e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e75 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404877.911057:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c6e00/0x24b3e2e6dcd79e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e75 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404877.911064:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6e00, rc 0) 00000100:00100000:3.0:1784404877.911092:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+7:17133:x1871083728958464:12345-0@lo:101:mount.lustre.0 Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404877.911109:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404877.911281:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404877.911293:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.911302:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404877.911313:0:17133:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784404877.911317:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.911324:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404877.911330:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784404877.911333:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784404877.911337:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd443e83000 10000000:01000000:1.0:1784404877.911346:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784404877.911349:0:17133:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784404877.911351:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784404877.911364:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.911372:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.911379:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404877.911390:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784404877.911412:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404877.911438:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5453133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404877.911482:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958592 00000100:00100000:3.0:1784404877.911486:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958592 00000100:00100000:3.0:1784404877.911511:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404877.911517:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+7:17133:x1871083728958592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404877.911524:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404877.911531:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c6a00/0x24b3e2e6dcd79e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79e83 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404877.911543:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c6a00/0x24b3e2e6dcd79e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e83 expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404877.911551:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c6a00/0x24b3e2e6dcd79e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e83 expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404877.911557:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6a00, rc 0) 00000100:00100000:3.0:1784404877.911581:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+8:17133:x1871083728958592:12345-0@lo:101:mount.lustre.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404877.911586:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784404877.911650:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404877.911660:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404877.911667:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404877.911710:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404877.911730:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404877.911755:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5453133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404877.911900:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958720 00000100:00100000:3.0:1784404877.911904:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958720 00000100:00100000:3.0:1784404877.911925:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784404877.911930:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+8:17133:x1871083728958720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404877.912053:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17133:x1871083728958720:12345-0@lo:501:mount.lustre.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404877.912059:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404877.912192:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404877.912218:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784404877.912256:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404877.912286:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5453133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404877.912327:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958848 00000100:00100000:3.0:1784404877.912331:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958848 00000100:00100000:3.0:1784404877.912356:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404877.912362:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17133:x1871083728958848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404877.917153:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17133:x1871083728958848:12345-0@lo:503:mount.lustre.0 Request processed in 4772us (4876us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404877.917175:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784404877.917314:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728958848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404877.917938:0:17171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17171:1871083728958976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404877.917999:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404877.918038:0:17171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404877.918172:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728958976 00000100:00100000:1.0:1784404877.918179:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728958976 00000100:00100000:1.0:1784404877.918220:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784404877.918230:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17171:x1871083728958976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404877.919258:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17171:x1871083728958976:12345-0@lo:502:llog_process_th.0 Request processed in 1022us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404877.919272:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784404877.919485:0:17171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17171:1871083728958976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784404877.919516:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404877.919527:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404877.919529:0:17171:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784404877.919534:0:17171:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784404877.919547:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404877.919563:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dd573b18000) 00000020:00000080:2.0:1784404877.919578:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784404877.919584:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784404877.919681:0:17171:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784404877.919690:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79e98 00000020:00000080:2.0:1784404877.920142:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784404877.920148:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404877.920153:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404877.920154:0:17171:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784404877.920157:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404877.920160:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404877.920162:0:17171:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784404877.920165:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404877.920182:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dd56cb74d40) 00000020:00000080:2.0:1784404877.920200:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784404877.920206:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784404877.920208:0:17171:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784404877.920211:0:17171:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784404877.920217:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784404877.920261:0:17171:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd443e83000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784404877.920274:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dd56cb719c0) 00000020:00000080:2.0:1784404877.920283:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784404877.920349:0:17171:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784404877.920355:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd79ead 00000020:00000080:2.0:1784404877.920440:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784404877.920447:0:17171:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784404877.920451:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x24b3e2e6dcd79eb4 00080000:01000000:2.0:1784404877.920456:0:17171:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784404877.920460:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79ebb 00010000:00010000:2.0:1784404878.073450:0:17171:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784404878.078492:0:17171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1784404878.079473:0:17171:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784404878.080302:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dd56cb73380) 00000020:00000080:2.0:1784404878.080324:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784404878.080421:0:17171:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784404878.080429:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79ec9 00000020:00000080:0.0:1784404878.085772:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784404878.098073:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x24b3e2e6dcd79ed0 00000020:00000080:2.0:1784404878.110473:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784404878.110490:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404878.110501:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.110503:0:17171:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784404878.110507:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784404878.110509:0:17171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1784404878.110511:0:17171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784404878.110512:0:17171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784404878.110513:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784404878.110516:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.110517:0:17171:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784404878.110520:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404878.110524:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.110525:0:17171:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784404878.110541:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784404878.110591:0:17171:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784404878.110608:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404878.110611:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.110612:0:17171:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784404878.110615:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404878.110618:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.110619:0:17171:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784404878.110621:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784404878.110626:0:17171:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:2.0:1784404878.110653:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404878.110669:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dd56cb70000) 00000020:00000080:2.0:1784404878.110684:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1784404878.110689:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784404878.111045:0:17171:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784404878.111051:0:17171:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784404878.111058:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79ede 00010000:00080000:2.0:1784404878.111091:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd573aad000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404878.115131:0:17171:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1784404878.124167:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784404878.124182:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784404878.124229:0:17171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784404878.124253:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd79ee5 00000100:00080000:2.0:1784404878.124263:0:17171:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404878.124270:0:17171:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd573aad000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404878.124322:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ff9500 x1871083728959104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404878.124355:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1784404878.124409:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404878.124412:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.124414:0:17171:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1784404878.124417:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784404878.124420:0:17171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1784404878.124421:0:17171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784404878.124423:0:17171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784404878.124424:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784404878.124427:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.124429:0:17171:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784404878.124431:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784404878.124436:0:17171:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784404878.124440:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.124443:0:17171:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:1.0:1784404878.124445:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728959104:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1784404878.124447:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784404878.124453:0:17171:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:2.0:1784404878.124477:0:17171:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784404878.124485:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404878.124507:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dd57d723380) 00000100:00100000:1.0:1784404878.124518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1784404878.124521:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000100:00100000:3.0:1784404878.124667:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728959232:0@lo:400:kworker.0 00000100:00100000:3.0:1784404878.124702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.124786:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728959232 00000100:00100000:3.0:1784404878.124793:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728959232 00000020:00000080:2.0:1784404878.125128:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784404878.125193:0:17171:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784404878.125199:0:17171:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784404878.125207:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79ef3 00010000:00080000:2.0:1784404878.125237:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd44319c800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404878.125446:0:17171:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1784404878.132456:0:17171:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784404878.132769:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728959104 00000100:00100000:1.0:1784404878.132780:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728959104 00000100:00100000:1.0:1784404878.132835:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404878.132843:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728959104:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1784404878.132890:0:17158:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784404878.132970:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728959104:12345-0@lo:38:llog_process_th.0 Request processed in 126us (8452us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404878.132978:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784404878.133056:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404878.133063:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784404878.133068:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728959104:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1784404878.133451:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784404878.133596:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404878.133611:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:3647:x1871083728959232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404878.133680:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:3647:x1871083728959232:12345-0@lo:400:kworker.0 Request processed in 76us (8977us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404878.133687:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404878.137473:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728959232:0@lo:400:kworker.0 00000040:00080000:3.0:1784404878.143843:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404878.145322:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1784404878.145505:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1784404878.148462:0:17177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784404878.148470:0:17177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784404878.149262:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784404878.149279:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784404878.149316:0:17171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784404878.149335:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd79efa 00000100:00080000:3.0:1784404878.149345:0:17171:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784404878.149351:0:17171:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404878.149384:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d1a680 x1871083728959360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404878.149413:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784404878.149468:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404878.149472:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404878.149474:0:17171:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784404878.149476:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784404878.149479:0:17171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1784404878.149481:0:17171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784404878.149482:0:17171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784404878.149484:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784404878.149486:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404878.149487:0:17171:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784404878.149489:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784404878.149493:0:17171:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784404878.149496:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404878.149497:0:17171:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784404878.149499:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784404878.149503:0:17171:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:3.0:1784404878.149526:0:17171:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784404878.149528:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784404878.149539:0:17171:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dd5704619c0) 00000020:00000080:3.0:1784404878.149550:0:17171:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1784404878.149554:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784404878.149616:0:17171:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784404878.149621:0:17171:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1784404878.149630:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd79f08 00010000:00080000:3.0:1784404878.149660:0:17171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd441a60000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784404878.149881:0:17171:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1784404878.149997:0:17171:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784404878.150012:0:17171:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784404878.153373:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728959360:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784404878.153450:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728959360 offset 0 length 520: 4 00000040:00080000:2.0:1784404878.161606:0:17171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784404878.161899:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1784404878.162056:0:17171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1784404878.164232:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784404878.164240:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784404878.166338:0:17171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784404878.166353:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784404878.166393:0:17171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784404878.166415:0:17171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd79f0f 00000100:00080000:2.0:1784404878.166428:0:17171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404878.166434:0:17171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd441a60000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404878.166472:0:17171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ffa680 x1871083728959488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404878.166548:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728959488:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784404878.166605:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728959488 offset 0 length 520: 4 00000100:00080000:2.0:1784404878.166662:0:17171:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784404878.166740:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404878.166745:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.166747:0:17171:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784404878.166765:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404878.166770:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.166771:0:17171:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784404878.166774:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784404878.166776:0:17171:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784404878.166778:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404878.166790:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.166791:0:17171:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784404878.166794:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404878.166796:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.166798:0:17171:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784404878.166801:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784404878.166831:0:17171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17171:1871083728959616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404878.166917:0:17171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404878.166939:0:17171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a59f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404878.167012:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728959616 00000100:00100000:1.0:1784404878.167019:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728959616 00000100:00100000:1.0:1784404878.167061:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784404878.167069:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17171:x1871083728959616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404878.167196:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17171:x1871083728959616:12345-0@lo:502:llog_process_th.0 Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404878.167204:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784404878.167433:0:17171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17171:1871083728959616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784404878.167463:0:17171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404878.167467:0:17171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404878.167469:0:17171:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784404878.167472:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1784404878.167639:0:17133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784404878.167668:0:17133:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784404878.167689:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.167699:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404878.167707:0:17133:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd443e83000 from 1 10000000:01000000:1.0:1784404878.167710:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784404878.167735:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.167743:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.167750:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404878.167764:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728959744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784404878.167805:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404878.167821:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404878.167848:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728959744 00000100:00100000:1.0:1784404878.167886:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728959744 00000100:00100000:1.0:1784404878.167912:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404878.167920:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+9:17133:x1871083728959744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404878.167929:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404878.167943:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79f16 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.167962:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.167979:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.167988:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758c00, rc 0) 00000100:00100000:1.0:1784404878.168018:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+10:17133:x1871083728959744:12345-0@lo:101:mount.lustre.0 Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404878.168024:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404878.168058:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728959744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404878.168070:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.168078:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404878.168616:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728959872:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784404878.168654:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404878.168680:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404878.168700:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728959872 00000100:00100000:1.0:1784404878.168704:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728959872 00000100:00100000:1.0:1784404878.168733:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404878.168741:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+10:17133:x1871083728959872:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784404878.168756:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784404878.168761:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784404878.168822:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+10:17133:x1871083728959872:12345-0@lo:256:mount.lustre.0 Request processed in 82us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404878.168829:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404878.168964:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728959872:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784404878.169573:0:17133:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784404878.169582:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.169592:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404878.169600:0:17133:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd443e83000 from 1 10000000:01000000:1.0:1784404878.169603:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404878.169629:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.169637:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.169645:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404878.169661:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784404878.169693:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404878.169731:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404878.170270:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960000 00000100:00100000:2.0:1784404878.170277:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960000 00000100:00100000:2.0:1784404878.170319:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784404878.170327:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+10:17133:x1871083728960000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784404878.170339:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404878.170354:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79f24 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.170374:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 11 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.170401:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 11 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.170409:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f800, rc 0) 00000100:00100000:2.0:1784404878.170450:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17133:x1871083728960000:12345-0@lo:101:mount.lustre.0 Request processed in 123us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404878.170456:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404878.170668:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404878.170684:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.170693:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404878.171120:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404878.171155:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404878.171215:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404878.171252:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960128 00000100:00100000:2.0:1784404878.171257:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960128 00000100:00100000:2.0:1784404878.171319:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784404878.171326:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17133:x1871083728960128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404878.171468:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17133:x1871083728960128:12345-0@lo:501:mount.lustre.0 Request processed in 142us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404878.171476:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404878.171542:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404878.171573:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404878.171618:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.171705:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd543d78840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404878.171793:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960256 00000100:00100000:1.0:1784404878.171797:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960256 00000100:00100000:1.0:1784404878.171822:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784404878.171828:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17133:x1871083728960256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784404878.172058:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17133:x1871083728960256:12345-0@lo:503:mount.lustre.0 Request processed in 228us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404878.172065:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784404878.172170:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784404878.172616:0:17181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17181:1871083728960384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404878.172657:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404878.172689:0:17181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404878.172802:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960384 00000100:00100000:1.0:1784404878.172807:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960384 00000100:00100000:1.0:1784404878.172839:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784404878.172847:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17181:x1871083728960384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404878.173458:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17181:x1871083728960384:12345-0@lo:502:llog_process_th.0 Request processed in 610us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404878.173467:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784404878.173550:0:17181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17181:1871083728960384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784404878.173575:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404878.173584:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404878.173587:0:17181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784404878.173593:0:17181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd443e83000 00000020:00000080:0.0:1784404878.173596:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404878.173604:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404878.173606:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404878.173608:0:17181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784404878.173610:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404878.173612:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404878.173614:0:17181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784404878.173617:0:17181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd443e83000 00000020:00000080:0.0:1784404878.173620:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404878.173683:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404878.173686:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404878.173688:0:17181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784404878.173691:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404878.173693:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404878.173695:0:17181:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784404878.173698:0:17181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd443e83000 00000020:00000080:0.0:1784404878.173701:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404878.173728:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404878.173732:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404878.173733:0:17181:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784404878.173736:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404878.173738:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404878.173739:0:17181:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784404878.173743:0:17181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd443e83000 00000020:00000080:0.0:1784404878.173745:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784404878.173961:0:17181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17181:1871083728960512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404878.174004:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404878.174048:0:17181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404878.174124:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960512 00000100:00100000:3.0:1784404878.174129:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960512 00000100:00100000:3.0:1784404878.174167:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784404878.174175:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17181:x1871083728960512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404878.174266:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17181:x1871083728960512:12345-0@lo:502:llog_process_th.0 Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404878.174273:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784404878.174312:0:17181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17181:1871083728960512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784404878.174330:0:17181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404878.174335:0:17181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404878.174337:0:17181:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784404878.174341:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784404878.174405:0:17133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784404878.174427:0:17133:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404878.174450:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.174472:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404878.174518:0:17133:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784404878.174521:0:17133:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd443e83000 10000000:01000000:3.0:1784404878.174525:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd443e83000 10000000:01000000:3.0:1784404878.174529:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784404878.174535:0:17133:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd443e83000 from 1 10000000:01000000:3.0:1784404878.174538:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784404878.174564:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.174571:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.174579:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404878.174593:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784404878.174625:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.174645:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd543d78840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404878.174659:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960640 00000100:00100000:3.0:1784404878.174663:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960640 00000100:00100000:3.0:1784404878.174680:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784404878.174686:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17133:x1871083728960640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404878.174694:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404878.174704:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c7a00/0x24b3e2e6dcd79f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79f32 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.174751:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c7a00/0x24b3e2e6dcd79f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f32 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.174761:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c7a00/0x24b3e2e6dcd79f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f32 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.174770:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7a00, rc 0) 00000100:00100000:3.0:1784404878.174809:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17133:x1871083728960640:12345-0@lo:101:mount.lustre.0 Request processed in 122us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404878.174815:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784404878.174847:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404878.175011:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.175020:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404878.175065:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404878.175100:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.175114:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd543d78840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404878.175128:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960768 00000100:00100000:3.0:1784404878.175132:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960768 00000100:00100000:3.0:1784404878.175148:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784404878.175153:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17133:x1871083728960768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404878.175257:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17133:x1871083728960768:12345-0@lo:501:mount.lustre.0 Request processed in 103us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404878.175273:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784404878.175305:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404878.175331:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404878.175368:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.175382:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd543d78840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404878.175394:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728960896 00000100:00100000:3.0:1784404878.175397:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728960896 00000100:00100000:3.0:1784404878.175414:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784404878.175419:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17133:x1871083728960896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404878.175501:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17133:x1871083728960896:12345-0@lo:503:mount.lustre.0 Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404878.175508:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784404878.175548:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728960896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404878.186918:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17184:1871083728961024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404878.187005:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.187047:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a61ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404878.187691:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961024 00000100:00100000:0.0:1784404878.187701:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961024 00000100:00100000:0.0:1784404878.187753:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784404878.187763:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17184:x1871083728961024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404878.187951:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17184:x1871083728961024:12345-0@lo:502:llog_process_th.0 Request processed in 189us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404878.187959:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784404878.188274:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17184:1871083728961024:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784404878.188340:0:17184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784404878.188357:0:17184:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dd570464d40) 00000020:00000080:3.0:1784404878.188379:0:17184:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1784404878.188572:0:17184:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd443e83000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784404878.188577:0:17184:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd443e83000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784404878.188580:0:17184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd443e83000 4 00010000:00080000:3.0:1784404878.188619:0:17184:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd574d39000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784404878.190261:0:17184:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1784404878.190368:0:17184:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784404878.190406:0:17184:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784404878.190421:0:17184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x24b3e2e6dcd79f47 00000100:00080000:3.0:1784404878.190431:0:17184:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784404878.190437:0:17184:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd574d39000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404878.190471:0:17184:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d19880 x1871083728961152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404878.190498:0:17184:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784404878.194035:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728961152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784404878.194145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.197356:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17184:1871083728961280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784404878.197450:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404878.197490:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a61ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404878.200114:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961280 00000100:00100000:2.0:1784404878.200133:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961280 00000100:00100000:2.0:1784404878.200209:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784404878.200220:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17184:x1871083728961280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784404878.200436:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17184:x1871083728961280:12345-0@lo:502:llog_process_th.0 Request processed in 218us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404878.200444:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784404878.201100:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961152 00000100:00100000:1.0:1784404878.201109:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961152 00000100:00100000:1.0:1784404878.201138:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404878.201144:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728961152:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784404878.201209:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728961152:12345-0@lo:38:llog_process_th.0 Request processed in 64us (7065us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784404878.201216:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404878.201266:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784404878.201287:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d39000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784404878.201291:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784404878.201296:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728961152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784404878.204041:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17184:1871083728961280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404878.204158:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17184:1871083728961408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784404878.211060:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404878.211141:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44370c780 going to sleep for 11 seconds 00000100:00100000:1.0:1784404878.211260:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961408 00000100:00100000:1.0:1784404878.211269:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961408 00000100:00100000:1.0:1784404878.211315:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784404878.211324:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17184:x1871083728961408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784404878.211490:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17184:x1871083728961408:12345-0@lo:502:llog_process_th.0 Request processed in 166us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404878.211498:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404878.211591:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17184:1871083728961408:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784404878.211624:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784404878.211790:0:17133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784404878.211815:0:17133:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404878.211830:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.211841:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784404878.211918:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784404878.211920:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784404878.211922:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404878.211923:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404878.211924:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404878.211926:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404878.211927:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784404878.211929:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784404878.211930:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404878.211932:0:17133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404878.211935:0:17133:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1784404878.211937:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784404878.211939:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784404878.211945:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404878.211946:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404878.211947:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404878.211948:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404878.211949:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784404878.211950:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784404878.211951:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404878.211952:0:17133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404878.211971:0:17133:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784404878.211988:0:17133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728961536:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784404878.212025:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404878.212044:0:17133:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44247e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404878.212273:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961536 00000100:00100000:0.0:1784404878.212279:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961536 00000100:00100000:0.0:1784404878.212316:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784404878.212324:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17133:x1871083728961536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784404878.212347:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784404878.212361:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784404878.222504:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784404878.222529:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784404878.222702:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784404878.222708:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784404878.222733:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.222750:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.222770:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.222821:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.222835:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 12 pid: 17149 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404878.223028:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728961664:0@lo:104: 00000100:00100000:2.0:1784404878.223114:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404878.223165:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a59f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404878.223515:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961664 00000100:00100000:0.0:1784404878.223524:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961664 00000100:00100000:0.0:1784404878.223615:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784404878.223625:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728961664:12345-0@lo:104: 00010000:00010000:0.0:1784404878.223650:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404878.223720:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784404878.223727:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728961664:12345-0@lo:104: Request processed in 103us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404878.223734:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784404878.224025:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404878.224033:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.224042:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404878.224047:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.224056:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404878.224064:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404878.224070:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404878.224125:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.224132:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404878.224153:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.224160:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd548759c00/0x24b3e2e6dcd79f16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f1d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.224177:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404878.224179:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404878.224181:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404878.224290:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728961792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404878.224329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404878.225135:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17133:x1871083728961536:12345-0@lo:253:mount.lustre.0 Request processed in 12808us (13105us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404878.225148:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784404878.225256:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961792 00000100:00100000:3.0:1784404878.225262:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961792 00010000:00010000:3.0:1784404878.225290:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 12 pid: 17149 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404878.225325:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404878.225334:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:3648:x1871083728961792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404878.225347:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404878.225353:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 12 pid: 17149 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225366:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 12 pid: 17149 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225386:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225396:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784404878.225421:0:17139:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002712274s 00010000:00010000:3.0:1784404878.225425:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225433:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225440:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225447:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225453:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404878.225458:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225466:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225476:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.225486:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404878.225520:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:3648:x1871083728961792:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404878.225527:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404878.226191:0:17133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17133:1871083728961536:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784404878.226205:0:17133:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784404878.226209:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784404878.226211:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784404878.226212:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404878.226214:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404878.226215:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404878.226216:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404878.226218:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784404878.226220:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784404878.226221:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404878.226223:0:17133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784404878.226241:0:17133:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1784404878.227110:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd548758c00/0x24b3e2e6dcd79f1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f16 expref: 11 pid: 17149 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404878.227129:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728961664:0@lo:104: 00010000:00010000:2.0:1784404878.227150:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.227159:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.227164:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404878.227170:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516f600/0x24b3e2e6dcd79f4e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404878.229156:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728961792:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784404878.272452:0:17133:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1784404878.272770:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1784404878.273155:0:17193:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1784404878.273160:0:17193:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1784404878.273276:0:17194:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1784404878.273662:0:17194:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404878.275743:0:17194:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784404878.275818:0:17194:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1784404878.276440:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:1.0:1784404878.287346:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784404878.287391:0:17133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784404878.287819:0:17133:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784404878.287827:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784404878.287921:0:17133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404878.288912:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784404878.289455:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784404878.289489:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:1.0:1784404878.289816:0:17195:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dd443cddc00 x1871083728961920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404878.289830:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00080000:10000000:3.0:1784404878.300298:0:17133:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1784404878.301755:0:17133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1784404878.305119:0:17133:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1784404878.305175:0:17133:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc2ae00ddb988 00100000:10000000:2.0:1784404878.305185:0:17133:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784404878.309055:0:17133:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784404878.309073:0:17133:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784404878.309107:0:17133:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784404878.309134:0:17133:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1784404878.309793:0:17133:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404878.310011:0:17133:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784404878.659174:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784404878.858275:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784404878.858283:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd443e83000 from 7 10000000:01000000:0.0:1784404878.858289:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784404878.858341:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404878.858354:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404878.858365:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404878.858394:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728962048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784404878.858494:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404878.858639:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44247e540 going to sleep for 11 seconds 00000100:00100000:1.0:1784404878.865003:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962048 00000100:00100000:1.0:1784404878.865017:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962048 00000100:00100000:1.0:1784404878.865210:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404878.865221:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+11:17151:x1871083728962048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404878.865242:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404878.865263:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79f55 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.865290:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.865301:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404878.865310:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759a00, rc 0) 00000100:00100000:1.0:1784404878.865396:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17151:x1871083728962048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (6901us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404878.865403:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784404878.865484:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728962048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404878.865519:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.865529:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404878.865593:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728962176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784404878.865632:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404878.875332:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962176 00000100:00100000:2.0:1784404878.875358:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962176 00000100:00100000:2.0:1784404878.876450:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784404878.876462:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17151:x1871083728962176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784404878.876486:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784404878.876500:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784404878.876504:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1784404878.876613:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17151:x1871083728962176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (10980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404878.876621:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784404878.883915:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784404878.883959:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728962176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784404878.884030:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784404878.884041:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404878.884051:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404879.303670:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00000040:00080000:3.0:1784404879.304692:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784404879.687754:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404880.322972:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00000040:00080000:3.0:1784404880.327262:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784404880.712619:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404881.358177:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:1.0:1784404881.733274:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404882.374567:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:1.0:1784404882.762162:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784404883.331396:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784404883.331403:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784404883.331406:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404883.331423:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:3.0:1784404883.331429:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784404883.331436:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd573aad000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404883.331459:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d1ad80 x1871083728962432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404883.331496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404883.331500:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404883.331503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404883.331507:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404883.331510:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784404883.331513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784404883.331515:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd574d39000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404883.331520:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd574d39000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404883.331536:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d18000 x1871083728962560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784404883.331582:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728962432:0@lo:38:kworker.0 00000100:00100000:3.0:1784404883.331673:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404883.331732:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728962560:0@lo:38:kworker.0 00000100:00100000:3.0:1784404883.331761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404883.331804:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962432 00000100:00100000:3.0:1784404883.331811:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962432 00000100:00100000:3.0:1784404883.331841:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404883.331867:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728962432:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784404883.331886:0:17158:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784404883.332713:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404883.332728:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728962304:0@lo:400:kworker.0 00000100:00100000:2.0:1784404883.332774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404883.332820:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962304 00000100:00100000:2.0:1784404883.332825:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962304 00000100:00100000:2.0:1784404883.332893:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784404883.332900:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:3648:x1871083728962304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404883.332949:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:3648:x1871083728962304:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404883.332956:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784404883.333006:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728962304:0@lo:400:kworker.0 00000100:00100000:0.0:1784404883.333558:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962560 00000100:00100000:0.0:1784404883.333564:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962560 00000100:00100000:0.0:1784404883.333600:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784404883.333607:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083728962560:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784404883.333640:0:17155:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:0.0:1784404883.333682:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x24b3e2e6dcd79f63 00000004:00100000:0.0:1784404883.333699:0:17155:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784404883.333842:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9dd442284800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404883.333920:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1871083728962560:12345-0@lo:38:kworker.0 Request processed in 313us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404883.333928:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784404883.333967:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd443d18000 x1871083728962560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784404883.333980:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784404883.333987:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784404883.333992:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784404883.333995:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d39000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784404883.334001:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083728962560:0@lo:38:kworker.0 00000100:00100000:2.0:1784404883.369950:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728962432:12345-0@lo:38:kworker.0 Request processed in 38093us (38269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784404883.369982:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784404883.369991:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404883.369999:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404883.370004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728962432:0@lo:38:kworker.0 00000100:00100000:0.0:1784404883.400222:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00000001:02000400:2.0:1784404883.496369:0:17438:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784404883.784331:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404884.426114:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00000020:00000004:3.0:1784404884.595399:0:17490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784404884.595588:0:17490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404884.808465:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404885.445221:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00000020:00000004:1.0:1784404885.510728:0:17540:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404885.511224:0:17540:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404885.830144:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404886.467390:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:0.0:1784404886.851332:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404887.490912:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:0.0:1784404887.876476:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784404888.452208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784404888.452216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784404888.452219:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404888.452227:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1784404888.452233:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784404888.452241:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd573aad000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404888.452262:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d1b100 x1871083728962816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404888.452277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404888.452280:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404888.452283:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404888.452285:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784404888.452311:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728962688:0@lo:400:kworker.0 00000100:00100000:3.0:1784404888.452374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404888.452434:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404888.452440:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728962944:0@lo:400:kworker.0 00000100:00100000:3.0:1784404888.452463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404888.452494:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404878/real 1784404878] req@ffff9dd577ffa680 x1871083728959488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404888 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404888.452511:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd577ffa680 x1871083728959488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404888 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404888.452532:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404878/real 1784404878] req@ffff9dd443d1a680 x1871083728959360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404888 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404888.452544:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd443d1a680 x1871083728959360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404888 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404888.452556:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728962816:0@lo:38:kworker.0 00000100:00100000:3.0:1784404888.452584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784404888.452608:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404888.452617:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784404888.452620:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728959488:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784404888.452625:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404888.452629:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784404888.452632:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728959360:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784404888.452666:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962688 00000100:00100000:3.0:1784404888.452673:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962688 00000100:00100000:3.0:1784404888.452727:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784404888.452738:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:3646:x1871083728962688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404888.452792:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:3646:x1871083728962688:12345-0@lo:400:kworker.0 Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404888.452800:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784404888.452899:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728962688:0@lo:400:kworker.0 00000100:00100000:3.0:1784404888.453327:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962944 00000100:00100000:3.0:1784404888.453332:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962944 00000100:00100000:3.0:1784404888.453360:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404888.453367:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728962944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404888.454335:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728962944:12345-0@lo:400:kworker.0 Request processed in 964us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404888.454344:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404888.454383:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728962816 00000100:00100000:3.0:1784404888.454389:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728962816 00000100:00100000:3.0:1784404888.454790:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784404888.454796:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083728962816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784404888.454814:0:17159:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1784404888.454835:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd443d1bb80 x1871083728962944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404888.454872:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728962944:0@lo:400:kworker.0 00000100:00080000:0.0:1784404888.458585:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784404888.458596:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784404888.458600:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404888.458609:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:0.0:1784404888.458614:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784404888.458621:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404888.458660:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443631500 x1871083728963072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784404888.458687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784404888.458691:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784404888.458693:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404888.458697:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:0.0:1784404888.458699:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784404888.458703:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd441a60000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404888.458715:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443633480 x1871083728963200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404888.466656:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728963072:0@lo:8:kworker.0 00000400:00000100:2.0:1784404888.466740:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728963072 offset 0 length 520: 4 00000100:00100000:2.0:1784404888.466782:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728963200:0@lo:8:kworker.0 00000400:00000100:2.0:1784404888.466803:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728963200 offset 0 length 520: 4 00000100:00100000:3.0:1784404888.476762:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083728962816:12345-0@lo:38:kworker.0 Request processed in 21954us (24166us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784404888.476777:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784404888.489744:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404888.489757:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404888.489762:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728962816:0@lo:38:kworker.0 00000100:00100000:1.0:1784404888.515070:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:1.0:1784404888.901186:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404889.539210:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:1.0:1784404889.926010:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404890.564729:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00000040:00080000:2.0:1784404890.569783:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784404890.953987:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404891.587147:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:0.0:1784404891.972501:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404892.613109:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00000020:01000004:0.0:1784404892.978798:0:17885:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784404892.978803:0:17885:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784404892.978805:0:17885:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784404892.979226:0:17885:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd442285000 00000020:01000004:0.0:1784404892.979257:0:17885:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1784404892.979270:0:17885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784404892.979286:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9dd573a8cd40) 00000020:00000080:0.0:1784404892.979303:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1784404892.996170:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1784404893.082700:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.085050:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784404893.088637:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1784404893.089026:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1784404893.089324:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1784404893.089549:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784404893.089732:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1784404893.090103:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1784404893.090438:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1784404893.090653:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784404893.090876:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1784404893.091123:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1784404893.091561:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1784404893.091833:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784404893.092641:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.094038:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.094375:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.094571:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.094783:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.095026:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.095356:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.095611:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.095937:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.096147:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.096472:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.096694:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.097383:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.098369:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.099530:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.100375:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.100726:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.102401:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.103047:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.103448:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1784404893.103841:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.105399:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784404893.107443:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1784404893.112263:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1784404893.113118:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1784404893.113544:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784404893.113807:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1784404893.114051:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784404893.114284:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784404893.114725:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784404893.115592:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1784404893.115834:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:2.0:1784404893.118728:0:17885:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784404893.119018:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1784404893.119028:0:17885:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784404893.119040:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd79f71 00000020:01000004:2.0:1784404893.119046:0:17885:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1784404893.119071:0:17885:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784404893.119074:0:17885:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784404893.119079:0:17885:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1784404893.119104:0:17885:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1784404893.119108:0:17885:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1784404893.130784:0:17885:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784404893.130826:0:17885:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1784404893.130831:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784404893.130832:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784404893.130834:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404893.130835:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404893.130836:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404893.130837:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404893.130838:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404893.130840:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404893.130841:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784404893.130845:0:17885:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1784404893.130847:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784404893.131024:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784404893.131026:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404893.131027:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404893.131028:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404893.131029:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404893.131030:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404893.131032:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404893.131033:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784404893.131060:0:17885:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784404893.131082:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784404893.131159:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.131250:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.131281:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728963328 00000100:00100000:1.0:1784404893.131289:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728963328 00000100:00100000:1.0:1784404893.131344:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784404893.131354:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17885:x1871083728963328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784404893.131393:0:17146:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784404893.131396:0:17146:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1784404893.131404:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784404893.133045:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17885:x1871083728963328:12345-0@lo:253:mount.lustre.0 Request processed in 1685us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.133057:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784404893.133178:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784404893.133195:0:17885:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784404893.133198:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784404893.133200:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784404893.133214:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404893.133216:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404893.133217:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404893.133218:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404893.133219:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404893.133221:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404893.133222:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784404893.133247:0:17885:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd442285000 from lustre-MDT0001 10000000:01000000:2.0:1784404893.133277:0:17885:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1784404893.133280:0:17885:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784404893.133286:0:17885:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd573b199c0 local copy 00010000:00010000:2.0:1784404893.133296:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404893.133396:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404893.133426:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404893.133552:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728963456 00000100:00100000:0.0:1784404893.133558:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728963456 00000100:00100000:0.0:1784404893.133599:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784404893.133609:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17885:x1871083728963456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404893.133691:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17885:x1871083728963456:12345-0@lo:501:mount.lustre.0 Request processed in 84us (264us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784404893.133698:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784404893.134236:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404893.134257:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963456:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784404893.134272:0:17885:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784404893.134295:0:17885:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784404893.134303:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.134442:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404893.134470:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd442285000 10000000:01000000:2.0:1784404893.134476:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784404893.134481:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dd573b199c0 10000000:01000000:2.0:1784404893.134484:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784404893.134487:0:17885:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dd573b199c0 from 1 10000000:01000000:2.0:1784404893.134500:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784404893.134526:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.134533:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.134542:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404893.134559:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784404893.134593:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.134764:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.136145:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728963584 00000100:00100000:1.0:1784404893.136156:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728963584 00000100:00100000:1.0:1784404893.136329:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404893.136340:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+12:17885:x1871083728963584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404893.136355:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404893.136377:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd548758200/0x24b3e2e6dcd79f7f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79f78 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.136405:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd548758200/0x24b3e2e6dcd79f7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f78 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.136416:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd548758200/0x24b3e2e6dcd79f7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f78 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.136425:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758200, rc 0) 00000100:00100000:1.0:1784404893.136498:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+13:17885:x1871083728963584:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.136505:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784404893.136590:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784404893.136608:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f7f expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.136617:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f7f expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404893.136638:0:17885:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784404893.136673:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f7f expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.136681:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f7f expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404893.136692:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd442285000 10000000:01000000:2.0:1784404893.136696:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784404893.136714:0:17885:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dd442285000 from 1 10000000:01000000:2.0:1784404893.136717:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784404893.136740:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.136748:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.136755:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404893.136776:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784404893.136815:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.137771:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576840 going to sleep for 11 seconds 00000100:00100000:0.0:1784404893.137808:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728963712 00000100:00100000:0.0:1784404893.137816:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728963712 00000100:00100000:0.0:1784404893.137885:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784404893.137896:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+13:17885:x1871083728963712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404893.137909:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404893.137926:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151ae00/0x24b3e2e6dcd79f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79f86 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.137952:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151ae00/0x24b3e2e6dcd79f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f86 expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.137973:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151ae00/0x24b3e2e6dcd79f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f86 expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.137982:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ae00, rc 0) 00000100:00100000:0.0:1784404893.138037:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+14:17885:x1871083728963712:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404893.138060:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784404893.138159:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784404893.138175:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.138183:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404893.138199:0:17885:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784404893.138209:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.138216:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404893.138223:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784404893.138234:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784404893.138240:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd442285000 10000000:01000000:2.0:1784404893.138242:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784404893.138246:0:17885:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784404893.138248:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784404893.138271:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.138279:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.138286:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404893.138304:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784404893.138351:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.138370:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576840 going to sleep for 11 seconds 00000100:00100000:0.0:1784404893.144927:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728963840 00000100:00100000:0.0:1784404893.144945:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728963840 00000100:00100000:0.0:1784404893.145014:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784404893.145026:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+14:17885:x1871083728963840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404893.145044:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404893.145063:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd79f9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd79f94 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.145094:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd79f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f94 expref: 15 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.145104:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd79f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f94 expref: 15 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.145113:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b800, rc 0) 00000100:00100000:0.0:1784404893.145200:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728963840:12345-0@lo:101:mount.lustre.0 Request processed in 176us (6848us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404893.145207:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784404893.145448:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784404893.145468:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.145477:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784404893.147239:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1784404893.148238:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404893.148629:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784404893.148654:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1784404893.148734:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1784404893.148746:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1784404893.148758:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1784404893.148769:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1784404893.148780:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1784404893.148792:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1784404893.148814:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1784404893.148832:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1784404893.148845:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1784404893.155768:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1784404893.155810:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1784404893.155825:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1784404893.155837:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1784404893.155864:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1784404893.155879:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1784404893.155890:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1784404893.155901:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1784404893.155913:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1784404893.155925:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1784404893.155938:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1784404893.155951:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1784404893.156003:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1784404893.156011:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1784404893.156160:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404893.156258:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404893.156518:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762180 going to sleep for 11 seconds 00000100:00100000:2.0:1784404893.157172:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728963968 00000100:00100000:2.0:1784404893.157184:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728963968 00000100:00100000:2.0:1784404893.157248:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784404893.157259:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728963968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404893.157467:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728963968:12345-0@lo:501:mount.lustre.0 Request processed in 209us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.157491:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784404893.157642:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728963968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404893.157760:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728964096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784404893.157810:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404893.158142:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762180 going to sleep for 11 seconds 00000100:00100000:3.0:1784404893.158621:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728964096 00000100:00100000:3.0:1784404893.158628:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728964096 00000100:00100000:3.0:1784404893.158737:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784404893.158746:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728964096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404893.160101:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728964096:12345-0@lo:503:mount.lustre.0 Request processed in 1349us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404893.160114:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404893.160261:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728964096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784404893.160834:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784404893.160969:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728964224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404893.161033:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.161072:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576840 going to sleep for 11 seconds 00000100:00100000:0.0:1784404893.161198:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728964224 00000100:00100000:0.0:1784404893.161206:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728964224 00000100:00100000:0.0:1784404893.161251:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784404893.161261:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728964224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404893.162041:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728964224:12345-0@lo:502:mount.lustre.0 Request processed in 780us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404893.162057:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404893.162145:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728964224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784404893.162801:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784404893.162832:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1784404893.162843:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1784404893.162894:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1784404893.162909:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1784404893.162920:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1784404893.162930:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1784404893.162940:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1784404893.162951:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1784404893.162972:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1784404893.162988:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1784404893.163000:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1784404893.163010:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1784404893.163021:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1784404893.163031:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1784404893.163042:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1784404893.163052:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1784404893.163062:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1784404893.163074:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1784404893.163085:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1784404893.163096:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1784404893.163116:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1784404893.163128:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1784404893.163141:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1784404893.163153:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1784404893.163166:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1784404893.163179:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1784404893.163192:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1784404893.163203:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1784404893.163214:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1784404893.163224:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1784404893.163234:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1784404893.163249:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1784404893.163261:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1784404893.163273:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1784404893.163287:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1784404893.163301:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1784404893.163746:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1784404893.163762:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1784404893.163773:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1784404893.163784:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1784404893.163795:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1784404893.163805:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1784404893.163816:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1784404893.163890:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728964352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404893.163970:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.164010:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54133a480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404893.164131:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728964352 00000100:00100000:0.0:1784404893.164138:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728964352 00000100:00100000:0.0:1784404893.164186:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784404893.164195:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728964352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404893.164322:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728964352:12345-0@lo:502:mount.lustre.0 Request processed in 128us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404893.164329:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784404893.164568:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728964352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784404893.164624:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1784404893.164634:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1784404893.165374:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404893.165387:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404893.165515:0:17889:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1784404893.165522:0:17889:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1784404893.165525:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404893.165538:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9dd57d720000) 00000020:00000080:2.0:1784404893.165560:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1784404893.165565:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784404893.165717:0:17889:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784404893.165725:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd79fa9 00000020:00000080:2.0:1784404893.166043:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1784404893.166049:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404893.166053:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404893.166054:0:17889:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1784404893.166057:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404893.166061:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404893.166062:0:17889:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1784404893.166065:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404893.166073:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9dd57d724d40) 00000020:00000080:2.0:1784404893.166083:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1784404893.166086:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784404893.166089:0:17889:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1784404893.166092:0:17889:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1784404893.166098:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784404893.166160:0:17889:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442285000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1784404893.166174:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9dd57d7219c0) 00000020:00000080:2.0:1784404893.166184:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1784404893.166235:0:17889:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784404893.166240:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd79fbe 00000020:00000080:2.0:1784404893.166735:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1784404893.166744:0:17889:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784404893.166748:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x24b3e2e6dcd79fc5 00080000:01000000:2.0:1784404893.166755:0:17889:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784404893.166759:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd79fcc 00010000:00010000:3.0:1784404893.255874:0:17889:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1784404893.257370:0:17889:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1784404893.257886:0:17889:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1784404893.265886:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1784404893.265901:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404893.265910:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.265912:0:17889:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1784404893.265917:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404893.265923:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.265924:0:17889:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1784404893.265928:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784404893.265934:0:17889:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:0.0:1784404893.265982:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784404893.266002:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9dd573a899c0) 00000020:00000080:0.0:1784404893.266029:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1784404893.266034:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784404893.266133:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1784404893.266140:0:17889:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784404893.266148:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd79fda 00010000:00080000:0.0:1784404893.266186:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd577f59800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:0.0:1784404893.269777:0:17889:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1784404893.271068:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784404893.271083:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784404893.271115:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784404893.271142:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd79fe1 00000100:00080000:0.0:1784404893.271152:0:17889:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784404893.271158:0:17889:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd577f59800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404893.271194:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443633b80 x1871083728964480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784404893.271226:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1784404893.271273:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404893.271277:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.271279:0:17889:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1784404893.271282:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784404893.271285:0:17889:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1784404893.271287:0:17889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784404893.271289:0:17889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784404893.271290:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784404893.271293:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.271294:0:17889:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784404893.271297:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404893.271301:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.271302:0:17889:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1784404893.271305:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784404893.271334:0:17889:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784404893.271345:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404893.271348:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.271350:0:17889:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1784404893.271352:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784404893.271354:0:17889:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1784404893.271355:0:17889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784404893.271356:0:17889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784404893.271358:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784404893.271360:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.271361:0:17889:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784404893.271364:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784404893.271367:0:17889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784404893.271375:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.271376:0:17889:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784404893.271379:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784404893.271383:0:17889:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000100:00080000:1.0:1784404893.271765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784404893.271771:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784404893.271774:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404893.271779:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:1.0:1784404893.271789:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784404893.271794:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd573aad000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404893.271811:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cdc700 x1871083728964608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404893.271822:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404893.271825:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784404893.271828:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404893.271831:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784404893.271888:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404893.271903:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728964736:0@lo:400:kworker.0 00000100:00100000:1.0:1784404893.271983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.272113:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728964480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784404893.272160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.272192:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728964608:0@lo:38:kworker.0 00000100:00100000:2.0:1784404893.272212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.272257:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728964736 00000100:00100000:2.0:1784404893.272264:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728964736 00000100:00100000:2.0:1784404893.272313:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784404893.272322:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728964736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404893.272375:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728964736:12345-0@lo:400:kworker.0 Request processed in 53us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.272382:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404893.272626:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728964480 00000100:00100000:1.0:1784404893.272631:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728964480 00000020:01000000:0.0:1784404893.273535:0:17889:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784404893.273542:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784404893.273562:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dd573a88000) 00000020:00000080:0.0:1784404893.273583:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784404893.273590:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1784404893.273757:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728964608 00000100:00100000:1.0:1784404893.273764:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728964608 00000100:00100000:1.0:1784404893.273786:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404893.273794:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728964480:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784404893.273819:0:17158:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:1.0:1784404893.273866:0:17158:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd79fef 00000004:00100000:1.0:1784404893.273881:0:17158:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784404893.273886:0:17158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:00080000:0.0:1784404893.274063:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1784404893.274071:0:17889:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784404893.274077:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd79ff6 00010000:00080000:0.0:1784404893.274111:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd443583000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:0.0:1784404893.274341:0:17889:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00010000:00080000:2.0:1784404893.274565:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd443cde300 x1871083728964736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404893.274580:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728964736:0@lo:400:kworker.0 00000040:01000000:0.0:1784404893.275970:0:17889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784404893.276267:0:17889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1784404893.278234:0:17889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784404893.278490:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1784404893.278604:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1784404893.279897:0:17894:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784404893.279903:0:17894:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:1.0:1784404893.282022:0:17158:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404893.282121:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083728964480:12345-0@lo:38:llog_process_th.0 Request processed in 8325us (9958us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.282132:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404893.282175:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404893.282183:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728964608:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784404893.282229:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083728964608:12345-0@lo:38:kworker.0 Request processed in 46us (10015us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784404893.282236:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784404893.282322:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404893.282333:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784404893.282342:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784404893.282348:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784404893.282350:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd577f59800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784404893.282370:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728964480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784404893.282382:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784404893.282384:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404893.282388:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784404893.282390:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728964608:0@lo:38:kworker.0 00000100:00100000:2.0:1784404893.282719:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728964864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404893.282761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.282801:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728964864 00000100:00100000:2.0:1784404893.282807:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728964864 00000100:00100000:2.0:1784404893.282875:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784404893.282882:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1871083728964864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404893.282908:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784404893.282948:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1871083728964864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.282954:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784404893.282998:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728964864:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1784404893.284989:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404893.285007:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784404893.285049:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784404893.285071:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd79ffd 00000100:00080000:1.0:1784404893.285081:0:17889:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784404893.285088:0:17889:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd443583000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404893.285126:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cde300 x1871083728964992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404893.285155:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784404893.285217:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404893.285221:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.285223:0:17889:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784404893.285226:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784404893.285229:0:17889:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1784404893.285231:0:17889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784404893.285232:0:17889:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784404893.285234:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784404893.285236:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.285237:0:17889:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784404893.285240:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784404893.285244:0:17889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784404893.285247:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.285248:0:17889:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784404893.285252:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784404893.285255:0:17889:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:1.0:1784404893.285281:0:17889:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784404893.285294:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784404893.285307:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dd442138000) 00000020:00000080:1.0:1784404893.285320:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1784404893.285326:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784404893.285389:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784404893.285396:0:17889:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784404893.285403:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd7a00b 00010000:00080000:1.0:1784404893.285435:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd548765000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784404893.285649:0:17889:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1784404893.285719:0:17889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784404893.285735:0:17889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1784404893.288283:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728964992:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784404893.288359:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728964992 offset 0 length 520: 4 00000100:00080000:3.0:1784404893.289044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404893.289068:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404893.289071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404893.289074:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1784404893.297051:0:17889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404893.297305:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1784404893.297473:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1784404893.298148:0:17896:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784404893.298154:0:17896:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784404893.298927:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404893.298940:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784404893.298994:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784404893.299018:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a012 00000100:00080000:1.0:1784404893.299028:0:17889:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784404893.299035:0:17889:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd548765000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404893.299078:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cddf80 x1871083728965120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404893.299156:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728965120:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784404893.299221:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728965120 offset 0 length 520: 4 00000100:00080000:1.0:1784404893.299280:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784404893.299368:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404893.299374:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404893.299377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404893.299381:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1784404893.299449:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404893.299453:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.299455:0:17889:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784404893.299458:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404893.299462:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.299464:0:17889:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784404893.299466:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784404893.299468:0:17889:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784404893.299479:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404893.299482:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.299483:0:17889:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784404893.299485:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404893.299488:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.299489:0:17889:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784404893.299492:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784404893.299520:0:17889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404893.299523:0:17889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404893.299524:0:17889:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784404893.299527:0:17889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1784404893.299675:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1784404893.299701:0:17885:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784404893.299725:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.299736:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404893.299744:0:17885:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442285000 from 1 10000000:01000000:0.0:1784404893.299746:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784404893.299776:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.299795:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404893.299806:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404893.299825:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784404893.299903:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404893.299924:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551762240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.300058:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728965248 00000100:00100000:1.0:1784404893.300065:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728965248 00000100:00100000:1.0:1784404893.300108:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404893.300118:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+15:17885:x1871083728965248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404893.300132:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404893.300145:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a019 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.300168:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 16 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.300179:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 16 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.300187:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758a00, rc 0) 00000100:00100000:1.0:1784404893.300236:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+16:17885:x1871083728965248:12345-0@lo:101:mount.lustre.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.300243:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784404893.300333:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404893.300348:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.300356:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404893.300974:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965376:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784404893.301025:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404893.301061:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44247ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.301141:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728965376 00000100:00100000:1.0:1784404893.301146:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728965376 00000100:00100000:1.0:1784404893.301193:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784404893.301201:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+16:17885:x1871083728965376:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784404893.301218:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784404893.301235:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784404893.301238:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1784404893.301326:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+16:17885:x1871083728965376:12345-0@lo:256:mount.lustre.0 Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.301333:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784404893.301373:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965376:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784404893.302022:0:17885:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784404893.302041:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.302051:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404893.302060:0:17885:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442285000 from 1 10000000:01000000:1.0:1784404893.302063:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404893.302093:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.302101:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.302110:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404893.302129:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784404893.302168:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.302208:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.302231:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728965504 00000100:00100000:1.0:1784404893.302236:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728965504 00000100:00100000:1.0:1784404893.302264:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784404893.302272:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+16:17885:x1871083728965504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404893.302283:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404893.302299:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a027 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.302322:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.302332:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.302342:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758800, rc 0) 00000100:00100000:1.0:1784404893.302373:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728965504:12345-0@lo:101:mount.lustre.0 Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.302379:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784404893.302419:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404893.302435:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.302444:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404893.302591:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784404893.302623:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404893.302648:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.302669:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.302682:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728965632 00000100:00100000:1.0:1784404893.302688:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728965632 00000100:00100000:1.0:1784404893.302704:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784404893.302709:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728965632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404893.302786:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728965632:12345-0@lo:501:mount.lustre.0 Request processed in 76us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.302792:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784404893.302821:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404893.302843:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784404893.302906:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.302925:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.302937:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728965760 00000100:00100000:1.0:1784404893.302941:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728965760 00000100:00100000:1.0:1784404893.302957:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784404893.302978:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728965760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784404893.303051:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728965760:12345-0@lo:503:mount.lustre.0 Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.303058:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784404893.303099:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784404893.303465:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784404893.303532:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404893.303565:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.303581:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.303595:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728965888 00000100:00100000:1.0:1784404893.303599:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728965888 00000100:00100000:1.0:1784404893.303623:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784404893.303629:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728965888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404893.303709:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728965888:12345-0@lo:502:mount.lustre.0 Request processed in 79us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.303716:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784404893.303754:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728965888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784404893.303955:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784404893.308493:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1784404893.308513:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1784404893.308528:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1784404893.308541:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1784404893.308555:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1784404893.308567:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1784404893.308579:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1784404893.308592:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784404893.308605:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1784404893.308616:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1784404893.308817:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404893.308952:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404893.309044:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966016 00000100:00100000:0.0:1784404893.309054:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966016 00000100:00100000:0.0:1784404893.309118:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784404893.309127:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728966016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404893.309246:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728966016:12345-0@lo:502:mount.lustre.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404893.309254:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784404893.309491:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404893.309516:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784404893.309581:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1784404893.309592:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1784404893.310338:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404893.310349:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310351:0:17898:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784404893.310358:0:17898:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd442285000 00000020:00000080:0.0:1784404893.310361:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404893.310370:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404893.310372:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310374:0:17898:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784404893.310376:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404893.310378:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310380:0:17898:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784404893.310383:0:17898:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd442285000 00000020:00000080:0.0:1784404893.310391:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404893.310456:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404893.310460:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310461:0:17898:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784404893.310464:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404893.310466:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310468:0:17898:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784404893.310471:0:17898:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd442285000 00000020:00000080:0.0:1784404893.310473:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404893.310490:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404893.310493:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310494:0:17898:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784404893.310497:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784404893.310499:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310500:0:17898:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784404893.310504:0:17898:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd442285000 00000020:00000080:0.0:1784404893.310506:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784404893.310528:0:17898:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784404893.310531:0:17898:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404893.310532:0:17898:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784404893.310535:0:17898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1784404893.314765:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784404893.314811:0:17885:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404893.314835:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.314859:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404893.314933:0:17885:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784404893.314935:0:17885:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd442285000 10000000:01000000:2.0:1784404893.314938:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd442285000 10000000:01000000:2.0:1784404893.314942:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784404893.314952:0:17885:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd442285000 from 1 10000000:01000000:2.0:1784404893.314955:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784404893.315006:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.315015:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.315027:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404893.315049:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784404893.315118:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.315155:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966144 00000100:00100000:2.0:1784404893.315162:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966144 00000100:00100000:2.0:1784404893.315201:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784404893.315209:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17885:x1871083728966144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784404893.315221:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404893.315231:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516f000/0x24b3e2e6dcd7a03c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a035 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.315253:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516f000/0x24b3e2e6dcd7a03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a035 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.315263:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516f000/0x24b3e2e6dcd7a03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a035 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.315272:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f000, rc 0) 00000100:00100000:2.0:1784404893.315299:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966144:12345-0@lo:101:mount.lustre.0 Request processed in 91us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.315314:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784404893.315362:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5503d3840 going to sleep for 11 seconds 00000100:00100000:2.0:1784404893.315381:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784404893.315395:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404893.315403:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404893.323530:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1784404893.323887:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784404893.324110:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1784404893.324137:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1784404893.324152:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1784404893.324165:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1784404893.324178:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1784404893.324192:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1784404893.324204:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1784404893.324218:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1784404893.324231:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1784404893.324244:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1784404893.324257:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1784404893.324271:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1784404893.324284:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1784404893.324295:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1784404893.324307:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1784404893.324334:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1784404893.324349:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1784404893.324362:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1784404893.324376:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1784404893.324400:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1784404893.324415:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1784404893.324429:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1784404893.324442:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1784404893.324457:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1784404893.324469:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1784404893.324481:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1784404893.324493:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1784404893.324506:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1784404893.324525:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1784404893.324531:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1784404893.324618:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404893.324697:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.324749:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966272 00000100:00100000:2.0:1784404893.324756:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966272 00000100:00100000:2.0:1784404893.324808:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404893.324817:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404893.324980:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966272:12345-0@lo:501:mount.lustre.0 Request processed in 163us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.324989:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784404893.325041:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485766c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404893.325067:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404893.325100:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404893.325140:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.325162:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966400 00000100:00100000:2.0:1784404893.325166:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966400 00000100:00100000:2.0:1784404893.325188:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404893.325194:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404893.325273:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966400:12345-0@lo:503:mount.lustre.0 Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.325279:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784404893.325317:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5485766c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404893.325328:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784404893.325726:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784404893.325791:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404893.325824:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.325870:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966528 00000100:00100000:2.0:1784404893.325875:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966528 00000100:00100000:2.0:1784404893.325898:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404893.325905:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404893.325991:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966528:12345-0@lo:502:mount.lustre.0 Request processed in 86us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.325999:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784404893.326034:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd553c64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404893.326047:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784404893.326192:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1784404893.326215:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1784404893.326227:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1784404893.326239:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1784404893.326250:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1784404893.326260:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1784404893.326272:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1784404893.326286:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1784404893.326299:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1784404893.326312:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1784404893.326336:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1784404893.326351:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1784404893.326365:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1784404893.326377:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1784404893.326388:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1784404893.326400:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1784404893.326424:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1784404893.326440:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1784404893.326451:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1784404893.326462:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1784404893.326474:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1784404893.326486:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1784404893.326498:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1784404893.326511:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1784404893.326524:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1784404893.326537:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1784404893.326551:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1784404893.326565:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1784404893.326576:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1784404893.326587:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1784404893.326601:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1784404893.326613:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1784404893.326637:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1784404893.326652:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1784404893.326665:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1784404893.326676:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1784404893.326687:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1784404893.326697:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1784404893.326707:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1784404893.326718:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1784404893.326727:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1784404893.326738:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1784404893.326750:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1784404893.326769:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1784404893.326781:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1784404893.326792:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1784404893.326803:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1784404893.326814:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1784404893.326879:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404893.326918:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404893.326953:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966656 00000100:00100000:3.0:1784404893.336194:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd553c64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404893.337642:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966656 00000100:00100000:2.0:1784404893.337806:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784404893.337818:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404893.338041:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966656:12345-0@lo:502:mount.lustre.0 Request processed in 225us (11121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404893.338050:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784404893.338471:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784404893.338828:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1784404893.338897:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1784404893.338939:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404893.339040:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.339079:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56cee9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404893.339148:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966784 00000100:00100000:3.0:1784404893.339158:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966784 00000100:00100000:3.0:1784404893.339201:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784404893.339210:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784404893.339323:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728966784:12345-0@lo:502:mount.lustre.0 Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404893.339331:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784404893.339409:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728966784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784404893.339453:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1784404893.339463:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1784404893.347629:0:17903:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1784404893.347712:0:17903:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9dd5445fb380) 00000020:00000080:2.0:1784404893.347744:0:17903:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1784404893.348033:0:17903:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442285000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784404893.348039:0:17903:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd442285000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784404893.348043:0:17903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442285000 3 00010000:00080000:2.0:1784404893.348080:0:17903:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd4436ab000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784404893.366630:0:17903:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1784404893.367228:0:17903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1784404893.367436:0:17903:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784404893.367453:0:17903:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x24b3e2e6dcd7a04a 00000100:00080000:1.0:1784404893.367464:0:17903:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784404893.367471:0:17903:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd4436ab000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404893.367514:0:17903:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cdea00 x1871083728966912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404893.367543:0:17903:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784404893.368333:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728966912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784404893.368441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.368837:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728966912 00000100:00100000:1.0:1784404893.368846:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728966912 00000100:00100000:1.0:1784404893.368919:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404893.368929:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083728966912:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784404893.368975:0:17155:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:1.0:1784404893.369022:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x24b3e2e6dcd7a051 00000004:00100000:1.0:1784404893.369045:0:17155:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784404893.369092:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7c000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1784404893.369477:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784404893.369484:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784404893.369487:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784404893.369490:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1784404893.371031:0:17903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1784404893.371290:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784404893.371325:0:17885:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404893.371352:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.371385:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784404893.371441:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784404893.371444:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784404893.371445:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404893.371447:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404893.371448:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404893.371449:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404893.371450:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784404893.371452:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404893.371454:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404893.371458:0:17885:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1784404893.371460:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784404893.371461:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784404893.371462:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404893.371463:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404893.371464:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404893.371465:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404893.371466:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784404893.371467:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404893.371468:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404893.371496:0:17885:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1784404893.371519:0:17885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728967040:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784404893.371598:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.371640:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967040 00000100:00100000:1.0:1784404893.371727:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967040 00000100:00100000:1.0:1784404893.371781:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784404893.371790:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728967040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784404893.371825:0:17147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784404893.371845:0:17147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784404893.372052:0:17885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56cee96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404893.379508:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1871083728966912:12345-0@lo:38:llog_process_th.0 Request processed in 10568us (11057us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404893.379522:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784404893.379643:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd443cdea00 x1871083728966912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404893.379656:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784404893.379665:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1784404893.379675:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784404893.379679:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784404893.379683:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd4436ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784404893.379690:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083728966912:0@lo:38:llog_process_th.0 00000001:00100000:0.0:1784404893.393344:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1784404893.393602:0:17147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784404893.393638:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784404893.394490:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17885:x1871083728967040:12345-0@lo:253:mount.lustre.0 Request processed in 22694us (22885us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.394504:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784404893.394577:0:17885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17885:1871083728967040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784404893.394593:0:17885:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784404893.394597:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784404893.394599:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784404893.394600:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404893.394602:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404893.394603:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404893.394604:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404893.394606:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784404893.394613:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404893.394615:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784404893.394632:0:17885:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1784404893.396495:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784404893.396508:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784404893.396542:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.396563:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.396572:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.396581:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.396663:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.396681:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 17 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404893.396696:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728967168:0@lo:104: 00000100:00100000:3.0:1784404893.396768:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784404893.396831:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.396841:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 17 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404893.396873:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728967296:0@lo:104: 00000100:00100000:1.0:1784404893.396894:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967168 00000100:00100000:3.0:1784404893.396901:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.396906:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967168 00000100:00100000:3.0:1784404893.396929:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44247e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404893.396952:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967296 00000100:00100000:3.0:1784404893.396967:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967296 00000100:00100000:1.0:1784404893.396975:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404893.396989:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:17169:x1871083728967168:12345-0@lo:104: 00010000:00010000:1.0:1784404893.397012:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397092:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784404893.397099:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:17169:x1871083728967168:12345-0@lo:104: Request processed in 113us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.397107:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404893.397130:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404893.397137:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728967296:12345-0@lo:104: 00010000:00010000:1.0:1784404893.397146:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397183:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784404893.397188:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728967296:12345-0@lo:104: Request processed in 53us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.397195:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784404893.397217:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784404893.397225:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397234:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404893.397247:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397260:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404893.397269:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404893.397275:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784404893.397315:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397323:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404893.397348:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397355:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a020 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397368:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404893.397371:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397377:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151be00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404893.397391:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.397398:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404893.397416:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404893.397421:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404893.397827:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404893.397883:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728967424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404893.397924:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404893.398018:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398025:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404893.398038:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398044:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd79f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f5c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398056:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404893.398058:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404893.398059:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404893.398067:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728967552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404893.398094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.398146:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967424 00000100:00100000:1.0:1784404893.398153:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967424 00010000:00010000:1.0:1784404893.398177:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 18 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404893.398203:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967552 00000100:00100000:1.0:1784404893.398206:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967552 00010000:00010000:1.0:1784404893.398217:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 19 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404893.398231:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404893.398247:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3646:x1871083728967424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404893.398261:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404893.398267:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 19 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398277:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 19 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398296:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404893.398322:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3646:x1871083728967424:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.398328:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404893.398343:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404893.398350:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3647:x1871083728967552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404893.398357:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404893.398361:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 18 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398370:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 18 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398382:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398391:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784404893.398406:0:17140:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002712274s 00010000:00010000:1.0:1784404893.398410:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398422:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398445:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398451:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398459:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404893.398462:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398470:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398477:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404893.398487:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404893.398519:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3647:x1871083728967552:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404893.398526:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404893.398563:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728967552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404893.398587:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728967424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404893.399407:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd548758a00/0x24b3e2e6dcd7a020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a019 expref: 17 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404893.399424:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728967168:0@lo:104: 00010000:00010000:3.0:1784404893.399436:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd79f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f55 expref: 16 pid: 17146 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404893.399444:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728967296:0@lo:104: 00010000:00010000:3.0:1784404893.399466:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.399488:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.399495:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404893.399502:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a058 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1784404893.426484:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1784404893.426559:0:17909:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1784404893.426564:0:17909:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1784404893.426888:0:17910:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1784404893.427752:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1784404893.427780:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1784404893.432560:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784404893.432652:0:17910:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1784404893.435906:0:17911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1871083728967680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784404893.436026:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.436084:0:17911:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56cee9c00 going to sleep for 11 seconds 00000040:01000000:2.0:1784404893.436573:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1784404893.436612:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784404893.437525:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967680 00000004:00000080:2.0:1784404893.437533:0:17885:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1784404893.437538:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967680 00000040:01000000:2.0:1784404893.437548:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1784404893.437611:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1784404893.437614:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784404893.437626:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1871083728967680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784404893.437732:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1871083728967680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404893.437740:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784404893.437833:0:17911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1871083728967680:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1784404893.437897:0:17911:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784404893.437938:0:17911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1871083728967808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784404893.437990:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.438012:0:17911:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546770840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404893.438063:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967808 00000100:00100000:3.0:1784404893.438068:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967808 00000100:00100000:3.0:1784404893.438097:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404893.438103:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1871083728967808:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784404893.438295:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1871083728967808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 192us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404893.438317:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784404893.438628:0:17911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1871083728967808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784404893.438701:0:17911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17911:1871083728967936:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784404893.438736:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.438774:0:17911:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56cee9300 going to sleep for 11 seconds 00000100:00100000:3.0:1784404893.438951:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728967936 00000100:00100000:3.0:1784404893.438966:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728967936 00000100:00100000:3.0:1784404893.439003:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404893.439011:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1871083728967936:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1784404893.439099:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1871083728967936:12345-0@lo:900:lod0001_rec0000.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000040:00080000:2.0:1784404893.439099:0:17885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1784404893.439111:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784404893.440332:0:17911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd443cdc000 x1871083728967936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784404909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404893.440349:0:17911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17911:1871083728967936:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784404893.440427:0:17911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1871083728968064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784404893.440509:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404893.440536:0:17911:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56cee9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784404893.440720:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968064 00000100:00100000:3.0:1784404893.440727:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968064 00000100:00100000:3.0:1784404893.440776:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404893.440785:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1871083728968064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784404893.440906:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1871083728968064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404893.440913:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784404893.441315:0:17911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1871083728968064:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1784404893.441369:0:17911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784404893.446495:0:17885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784404893.446951:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1784404893.447201:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784404893.447838:0:17885:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1784404893.456400:0:17885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1784404893.457994:0:17885:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784404893.458028:0:17885:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc2ae01c73988 00100000:10000000:3.0:1784404893.458035:0:17885:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1784404893.460838:0:17911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784404893.460952:0:17911:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784404893.460967:0:17911:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:2.0:1784404893.465463:0:17885:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784404893.465496:0:17885:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784404893.465514:0:17885:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784404893.465543:0:17885:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1784404893.466384:0:17885:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404893.466610:0:17885:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784404893.637062:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:2.0:1784404894.019985:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784404894.407479:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784404894.658924:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 10000000:01000000:0.0:1784404895.042989:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784404895.042998:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442285000 from 8 10000000:01000000:0.0:1784404895.043003:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784404895.043064:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.043078:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.043090:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404895.043122:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784404895.043202:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404895.043267:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54b40 going to sleep for 11 seconds 00010000:00010000:1.0:1784404895.043456:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404895.043522:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968192 00000100:00100000:2.0:1784404895.043531:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968192 00000100:00100000:2.0:1784404895.043583:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784404895.043592:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+16:17151:x1871083728968192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404895.043606:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404895.043619:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a05f expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404895.043643:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404895.043653:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404895.043663:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516ec00, rc 0) 00000100:00100000:2.0:1784404895.043768:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728968192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404895.043777:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784404895.049085:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404895.049120:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.049132:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404895.049226:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784404895.049301:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404895.049342:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404895.049445:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968320 00000100:00100000:1.0:1784404895.049462:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968320 00000100:00100000:1.0:1784404895.049524:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784404895.049533:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728968320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784404895.049552:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784404895.049568:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784404895.049576:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1784404895.049676:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728968320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404895.049684:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784404895.049959:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784404895.050010:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784404895.050018:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.050026:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404895.050036:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784404895.050038:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd443e83000 from 8 10000000:01000000:0.0:1784404895.050041:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784404895.050066:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.050073:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.050082:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404895.050095:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784404895.050123:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404895.050151:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404895.050218:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968448 00000100:00100000:2.0:1784404895.050223:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968448 00000100:00100000:2.0:1784404895.050263:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784404895.050270:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728968448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404895.050280:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404895.050293:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a06d expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404895.050313:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 18 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404895.050322:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 18 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404895.050331:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f400, rc 0) 00000100:00100000:2.0:1784404895.050371:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728968448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404895.050377:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784404895.050607:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404895.050626:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.050635:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404895.050675:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784404895.050704:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404895.050724:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404895.050776:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968576 00000100:00100000:2.0:1784404895.050781:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968576 00000100:00100000:2.0:1784404895.050810:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784404895.050826:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728968576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784404895.050838:0:17146:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784404895.050890:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784404895.050894:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1784404895.050968:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728968576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404895.050979:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784404895.051052:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728968576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784404895.051087:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784404895.051092:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404895.051099:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784404895.427709:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784404895.684141:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:1.0:1784404896.068295:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404896.711750:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:0.0:1784404897.091137:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404897.738638:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 0 seconds 00010000:00010000:2.0:1784404898.116187:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784404898.158992:0:18154:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784404898.692395:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728968704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404898.692473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404898.692661:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968704 00000100:00100000:2.0:1784404898.692669:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968704 00000100:00100000:2.0:1784404898.692724:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404898.692734:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728968704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404898.692771:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784404898.692825:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728968704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404898.692833:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404898.694503:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728968704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404898.703069:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728968832:0@lo:400:kworker.0 00000100:00100000:2.0:1784404898.703147:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404898.703247:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968832 00000100:00100000:0.0:1784404898.703255:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968832 00000100:00100000:0.0:1784404898.703305:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784404898.703314:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3649:x1871083728968832:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784404898.703380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784404898.703385:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784404898.703388:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404898.703396:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd573aad000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404898.703419:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cdf800 x1871083728968960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404898.703449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404898.703452:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784404898.703455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404898.703458:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784404898.703478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404898.703482:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784404898.703484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404898.703487:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784404898.703514:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728968960:0@lo:38:kworker.0 00000100:00100000:1.0:1784404898.703547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404898.703581:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728969088:0@lo:400:kworker.0 00000100:00100000:1.0:1784404898.703607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404898.703643:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404898.703649:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728969216:0@lo:400:kworker.0 00000100:00100000:1.0:1784404898.703670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404898.703701:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969088 00000100:00100000:1.0:1784404898.703704:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969088 00000100:00100000:1.0:1784404898.703729:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969216 00000100:00100000:1.0:1784404898.703732:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969216 00000100:00100000:1.0:1784404898.703746:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404898.703751:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728969088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404898.703789:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728969088:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404898.703795:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404898.703813:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404898.703818:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728969216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404898.703885:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083728969216:12345-0@lo:400:kworker.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404898.703892:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784404898.703959:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd443cdc000 x1871083728969216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404898.703972:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083728969216:0@lo:400:kworker.0 00010000:00080000:1.0:1784404898.703982:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd443cded80 x1871083728969088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404898.703989:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728969088:0@lo:400:kworker.0 00000100:00100000:1.0:1784404898.704013:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728968960 00000100:00100000:1.0:1784404898.704017:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728968960 00000100:00100000:1.0:1784404898.704035:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784404898.704046:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083728968960:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784404898.704069:0:17159:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:1.0:1784404898.704100:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a07b 00000004:00100000:1.0:1784404898.704114:0:17159:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784404898.704119:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1784404898.714432:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3649:x1871083728968832:12345-0@lo:400:kworker.0 Request processed in 11100us (11266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404898.714448:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784404898.718126:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728968832:0@lo:400:kworker.0 00000100:00080000:2.0:1784404898.735901:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9dd4436a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404898.736605:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083728968960:12345-0@lo:38:kworker.0 Request processed in 31967us (32466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404898.736619:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1784404898.736959:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784404898.736969:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1784404898.736975:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784404898.736979:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1784404898.736998:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c35fa695): req@ffff9dd443cddc00 x1871083728961920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404898.737028:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728968960:0@lo:38:kworker.0 00000100:00100000:3.0:1784404898.737153:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404898.737175:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404898.737190:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728969344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404898.737195:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1784404898.737214:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728961920 00000100:00100000:3.0:1784404898.737219:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728961920 00000100:00100000:3.0:1784404898.737270:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404898.737279:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1871083728961920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784404898.737305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404898.737328:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1784404898.737358:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1871083728961920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404898.737365:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404898.737379:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969344 00000100:00100000:3.0:1784404898.737463:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969344 00000100:00100000:3.0:1784404898.737483:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404898.737488:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728969344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404898.737512:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784404898.737517:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1784404898.737550:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083728969344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404898.737556:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404898.737584:0:17195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1871083728961920:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784404898.737618:0:17195:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784404898.737653:0:17195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1871083728969472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784404898.737667:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728969344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404898.737689:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404898.737716:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af480 going to sleep for 11 seconds 00000100:00100000:2.0:1784404898.737717:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969472 00000100:00100000:2.0:1784404898.737723:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969472 00000100:00100000:2.0:1784404898.737763:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784404898.737770:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1871083728969472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784404898.737890:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1871083728969472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 119us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404898.737897:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404898.737943:0:17195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1871083728969472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784404898.738014:0:17195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d19f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1871083728969600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784404898.738037:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404898.738066:0:17195:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af480 going to sleep for 11 seconds 00000100:00100000:3.0:1784404898.738080:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969600 00000100:00100000:3.0:1784404898.738084:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969600 00000100:00100000:3.0:1784404898.738108:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404898.738114:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1871083728969600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784404898.738161:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1871083728969600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404898.738167:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404898.738191:0:17195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d19f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1871083728969600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784404898.738226:0:17195:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404898.748075:0:17195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784404898.748168:0:17195:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1784404898.748174:0:17195:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1784404899.140718:0:18207:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404899.140971:0:18207:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784404899.145501:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784404899.960969:0:18258:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404899.961180:0:18258:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784404900.165395:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784404900.805633:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1784404901.046615:0:18306:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef2f82a40 20000000:00000080:3.0:1784404901.046635:0:18306:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd544586800 uarg=0000000000000000 20000000:01000000:3.0:1784404901.046700:0:18306:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784404901.046707:0:18306:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784404901.046712:0:18306:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1784404901.047390:0:18307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1784404901.047534:0:18306:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784404901.057139:0:18306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784404901.063053:0:18306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.063082:0:18306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.063091:0:18306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.063099:0:18306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.063149:0:18306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.063820:0:18306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 17 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404901.063837:0:18306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1871083728969728:0@lo:104: 00000100:00100000:2.0:1784404901.064277:0:18306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784404901.064394:0:18306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.064420:0:18306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 17 pid: 17146 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404901.064430:0:18306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1871083728969856:0@lo:104: 00000100:00100000:2.0:1784404901.064470:0:18306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404901.066354:0:18306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784404901.066442:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969728 00000100:00100000:1.0:1784404901.066451:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969728 00000100:00100000:0.0:1784404901.066554:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969856 00000100:00100000:0.0:1784404901.066559:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969856 00000100:00100000:0.0:1784404901.066575:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404901.066596:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:18306:x1871083728969728:12345-0@lo:104: 00010000:00010000:0.0:1784404901.066611:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.066720:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784404901.066727:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:18306:x1871083728969728:12345-0@lo:104: Request processed in 134us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404901.066734:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404901.066753:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784404901.066759:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:18306:x1871083728969856:12345-0@lo:104: 00010000:00010000:0.0:1784404901.066767:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.066804:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784404901.066809:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:18306:x1871083728969856:12345-0@lo:104: Request processed in 52us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404901.066816:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1784404901.066832:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404901.066838:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.066845:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404901.066882:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.066919:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404901.066927:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404901.066932:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784404901.066964:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.066970:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404901.066992:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067010:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd548758c00/0x24b3e2e6dcd7a027 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a02e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067024:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404901.067027:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067038:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404901.067042:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067049:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404901.067055:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404901.067066:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784404901.067082:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067088:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404901.067103:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067110:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd548759200/0x24b3e2e6dcd79f24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd79f2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067123:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404901.067125:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404901.067126:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404901.067170:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728969984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404901.067209:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404901.067250:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728970112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404901.067271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404901.067326:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728969984 00000100:00100000:0.0:1784404901.067330:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728969984 00010000:00010000:0.0:1784404901.067348:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 18 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404901.067368:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728970112 00000100:00100000:0.0:1784404901.067371:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728970112 00010000:00010000:0.0:1784404901.067382:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 19 pid: 17146 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404901.067393:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404901.067406:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3649:x1871083728969984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404901.067417:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404901.067422:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 19 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067433:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 19 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067449:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404901.067477:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3649:x1871083728969984:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404901.067483:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404901.067495:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784404901.067500:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3646:x1871083728970112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404901.067507:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404901.067511:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 18 pid: 17146 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067520:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 18 pid: 17146 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067531:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067539:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067552:0:17141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067568:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067576:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067582:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067588:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404901.067592:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067599:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067607:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404901.067617:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404901.067642:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3646:x1871083728970112:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404901.067648:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784404901.067697:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728970112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404901.067720:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728969984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404901.067807:0:18306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd548758800/0x24b3e2e6dcd7a02e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a027 expref: 17 pid: 17149 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404901.067818:0:18306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1871083728969728:0@lo:104: 00010000:00010000:2.0:1784404901.067828:0:18306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd79f2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd79f24 expref: 16 pid: 17146 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404901.067835:0:18306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1871083728969856:0@lo:104: 00010000:00010000:2.0:1784404901.067906:0:18306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.067915:0:18306:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.067920:0:18306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404901.067926:0:18306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a082 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404901.069633:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404901.187115:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404902.216180:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784404902.339110:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784404902.339118:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442285000 from 13 10000000:01000000:0.0:1784404902.339129:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784404902.339169:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404902.339181:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404902.339192:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404902.339217:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784404902.339283:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404902.339327:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404902.339420:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728970240 00000100:00100000:1.0:1784404902.339429:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728970240 00000100:00100000:1.0:1784404902.339476:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784404902.339485:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+16:17151:x1871083728970240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404902.339498:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404902.339511:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a089 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404902.339546:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404902.339556:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404902.339566:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758400, rc 0) 00000100:00100000:1.0:1784404902.339616:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728970240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404902.339623:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784404902.339748:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404902.339764:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404902.339773:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404902.339844:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404902.339920:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404902.339943:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404902.340045:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728970368 00000100:00100000:2.0:1784404902.340050:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728970368 00000100:00100000:2.0:1784404902.340076:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784404902.340089:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728970368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.340203:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728970368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404902.340209:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784404902.340273:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404902.340303:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404902.340461:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404902.340557:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54240 going to sleep for 11 seconds 00000100:00100000:2.0:1784404902.342168:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728970496 00000100:00100000:2.0:1784404902.342180:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728970496 00000100:00100000:2.0:1784404902.342221:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784404902.342229:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728970496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.342368:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728970496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404902.342376:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784404902.342430:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784404902.343116:0:18373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784404902.343167:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784404902.343186:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404902.343194:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.343204:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404902.343213:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784404902.343215:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd443e83000 from 13 10000000:01000000:2.0:1784404902.343218:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784404902.343250:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.343258:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.343279:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404902.343302:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.343345:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404902.343368:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404902.343383:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728970624 00000100:00100000:2.0:1784404902.343388:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728970624 00000100:00100000:2.0:1784404902.343418:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404902.343426:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+17:17151:x1871083728970624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404902.343435:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404902.343448:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a097 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.343469:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.343479:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.343488:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e600, rc 0) 00000100:00100000:2.0:1784404902.343519:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728970624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404902.343525:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404902.343561:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404902.343574:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.343589:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404902.343636:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.343659:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404902.343672:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404902.343682:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728970752 00000100:00100000:2.0:1784404902.343685:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728970752 00000100:00100000:2.0:1784404902.343705:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784404902.343711:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728970752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.343803:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728970752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404902.343810:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784404902.343838:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.343902:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.343938:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404902.343952:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404902.343962:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728970880 00000100:00100000:2.0:1784404902.343965:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728970880 00000100:00100000:2.0:1784404902.343983:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404902.343988:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728970880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784404902.344045:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:17151:x1871083728970880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404902.344050:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784404902.344082:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728970880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784404902.344651:0:18374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784404902.344694:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784404902.344708:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784404902.344715:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404902.344723:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404903.244517:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404903.811230:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728971136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404903.811230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728971008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404903.811278:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728971264:0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.811942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404903.812023:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404893/real 1784404893] req@ffff9dd443cddf80 x1871083728965120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.812044:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd443cddf80 x1871083728965120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.812054:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404893/real 1784404893] req@ffff9dd443cde300 x1871083728964992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.812064:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd443cde300 x1871083728964992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.812072:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404888/real 1784404888] req@ffff9dd443631500 x1871083728963072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.812082:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd443631500 x1871083728963072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.812091:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404888/real 1784404888] req@ffff9dd443633480 x1871083728963200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.812103:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd443633480 x1871083728963200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404903 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784404903.812114:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404903.812127:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784404903.812130:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728965120:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784404903.812136:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404903.812156:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784404903.812159:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728964992:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784404903.812163:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404903.812167:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784404903.812169:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728963072:0@lo:8:kworker.0 00000100:00080000:0.0:1784404903.812173:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404903.812176:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784404903.812178:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728963200:0@lo:8:kworker.0 00000100:00100000:0.0:1784404903.812229:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728971008 00000100:00100000:0.0:1784404903.812236:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728971008 00000100:00100000:0.0:1784404903.812280:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784404903.812288:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728971008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404903.812327:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784404903.812376:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083728971008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404903.812383:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784404903.812424:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728971008:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784404903.812508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404903.812513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784404903.812516:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404903.812521:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1784404903.812525:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784404903.812529:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404903.812553:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ffb480 x1871083728971392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404903.812573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404903.812576:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784404903.812578:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404903.812580:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1784404903.812583:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784404903.812585:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd441a60000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404903.812594:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ffb800 x1871083728971520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404903.812628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404903.812631:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784404903.812632:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404903.812635:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1784404903.812638:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784404903.812641:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd443583000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404903.812649:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ff9c00 x1871083728971904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404903.812655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404903.812658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784404903.812659:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404903.812662:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1784404903.812664:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784404903.812667:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd548765000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404903.812673:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ff8380 x1871083728972032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404903.813004:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728971648:0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.813045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404903.813080:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404903.813086:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728971776:0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.813109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404903.813133:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728971392:0@lo:8:kworker.0 00000400:00000100:0.0:1784404903.813151:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728971392 offset 0 length 520: 4 00000100:00100000:0.0:1784404903.813180:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728971520:0@lo:8:kworker.0 00000400:00000100:0.0:1784404903.813196:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728971520 offset 0 length 520: 4 00000100:00100000:0.0:1784404903.813206:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728971904:0@lo:8:kworker.0 00000400:00000100:0.0:1784404903.813224:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728971904 offset 0 length 520: 4 00000100:00100000:0.0:1784404903.813234:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728972032:0@lo:8:kworker.0 00000400:00000100:0.0:1784404903.813251:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083728972032 offset 0 length 520: 4 00000100:00100000:2.0:1784404903.813286:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728971648 00000100:00100000:2.0:1784404903.813292:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728971648 00000100:00100000:2.0:1784404903.813328:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784404903.813337:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728971648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.813475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404903.813493:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404903.813499:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728972160:0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.813522:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404903.813544:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728971264 00000100:00100000:0.0:1784404903.813547:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728971264 00000100:00100000:0.0:1784404903.813575:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784404903.813582:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3649:x1871083728971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.813616:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:3649:x1871083728971264:12345-0@lo:400:kworker.0 Request processed in 34us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404903.813623:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784404903.813653:0:17155:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784404903.813660:0:17155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784404903.813787:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728971264:0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.813822:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728972160 00000100:00100000:0.0:1784404903.813826:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728972160 00000100:00100000:0.0:1784404903.813845:0:17155:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784404903.813887:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784404903.813894:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728972160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.813929:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728972160:12345-0@lo:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404903.813943:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784404903.813971:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd577ff8e00 x1871083728972160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404903.813982:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728972160:0@lo:400:kworker.0 00000100:00100000:2.0:1784404903.814251:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728971648:12345-0@lo:400:kworker.0 Request processed in 915us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404903.814259:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784404903.814280:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728971776 00000100:00100000:2.0:1784404903.814290:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728971776 00000100:00100000:2.0:1784404903.814324:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404903.814331:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728971776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404903.814367:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728971776:12345-0@lo:400:kworker.0 Request processed in 37us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404903.814373:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784404903.815640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404903.815798:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728971136 00000100:00100000:2.0:1784404903.815807:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728971136 00000100:00100000:2.0:1784404903.815887:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784404903.815897:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728971136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404903.815931:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784404903.816020:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728971136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404903.816027:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784404903.818076:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728971136:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1784404903.821127:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd577ff9180 x1871083728971648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404903.821148:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728971648:0@lo:400:kworker.0 00000100:00100000:0.0:1784404903.823290:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728971776:0@lo:400:kworker.0 00010000:00010000:3.0:1784404904.279125:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784404904.334534:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784404905.292834:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784404905.667515:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784404906.313400:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404907.332252:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404908.360819:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784404908.473794:0:18655:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784404908.473801:0:18655:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784404908.473803:0:18655:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1784404908.473968:0:18655:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd573845800 00000020:01000004:3.0:1784404908.473987:0:18655:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784404908.474016:0:18655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784404908.474030:0:18655:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dd570460000) 00000020:00000080:3.0:1784404908.474049:0:18655:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784404908.549026:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784404908.550120:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784404908.550624:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784404908.551074:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1784404908.551290:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784404908.551489:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1784404908.551937:0:18655:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1784404908.556271:0:18655:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784404908.556591:0:18655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784404908.556607:0:18655:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784404908.556622:0:18655:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b3e2e6dcd7a0ac 00000020:01000004:2.0:1784404908.556628:0:18655:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784404908.556651:0:18655:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784404908.556654:0:18655:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784404908.556661:0:18655:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784404908.556666:0:18655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784404908.556679:0:18655:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dd5445f8000) 00000020:00000080:2.0:1784404908.556690:0:18655:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1784404908.558337:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404908.558513:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784404908.558528:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784404908.565491:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784404908.565632:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1784404908.566183:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1784404908.566192:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784404908.570499:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784404908.571080:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784404908.571087:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784404908.576312:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784404908.576325:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1784404908.616377:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784404908.617085:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784404908.617094:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1784404908.619044:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784404908.619143:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784404908.620601:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784404908.620612:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784404908.627235:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404908.628681:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784404908.628695:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784404908.631408:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784404908.631424:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784404908.702894:0:18655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784404908.703102:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784404908.703110:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784404908.711144:0:18655:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784404908.711166:0:18655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784404908.716712:0:18655:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784404908.716762:0:18655:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1784404908.716772:0:18655:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784404908.749368:0:18655:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784404908.749426:0:18655:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784404908.749431:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784404908.749433:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784404908.749434:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404908.749436:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404908.749437:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404908.749438:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404908.749440:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784404908.749442:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404908.749444:0:18655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784404908.749447:0:18655:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784404908.749450:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784404908.749451:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784404908.749452:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404908.749453:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404908.749454:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404908.749455:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404908.749456:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784404908.749463:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404908.749464:0:18655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784404908.749494:0:18655:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784404908.749578:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784404908.749664:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404908.749762:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af900 going to sleep for 11 seconds 00000100:00100000:1.0:1784404908.751434:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728972288 00000100:00100000:1.0:1784404908.751450:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728972288 00000100:00100000:1.0:1784404908.751619:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784404908.751631:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:18655:x1871083728972288:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784404908.751696:0:17149:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784404908.751701:0:17149:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1784404908.751705:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784404908.752428:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:18655:x1871083728972288:12345-0@lo:253:mount.lustre.0 Request processed in 794us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404908.752438:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784404908.752587:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972288:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784404908.752602:0:18655:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784404908.752605:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784404908.752607:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784404908.752608:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404908.752609:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404908.752610:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404908.752612:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404908.752613:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784404908.752615:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404908.752617:0:18655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784404908.752637:0:18655:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd573845800 from lustre-OST0000 10000000:01000000:3.0:1784404908.752680:0:18655:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784404908.752684:0:18655:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784404908.752693:0:18655:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd573b199c0 local copy 00010000:00010000:3.0:1784404908.752707:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404908.752879:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404908.752932:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404908.757582:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e3f600 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.764485:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728972416 00000100:00100000:0.0:1784404908.764502:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728972416 00000100:00100000:0.0:1784404908.764624:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784404908.764635:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:18655:x1871083728972416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404908.765192:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:18655:x1871083728972416:12345-0@lo:501:mount.lustre.0 Request processed in 557us (12258us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784404908.765202:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784404908.765343:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972416:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784404908.765368:0:18655:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784404908.765396:0:18655:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784404908.765405:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.765416:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404908.765449:0:18655:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd573845800 10000000:01000000:3.0:1784404908.765454:0:18655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784404908.765460:0:18655:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784404908.765463:0:18655:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784404908.765467:0:18655:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784404908.765470:0:18655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784404908.765500:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.765520:0:18655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.765529:0:18655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404908.765551:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784404908.765592:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404908.765647:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e3f600 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.765753:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728972544 00000100:00100000:0.0:1784404908.765766:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728972544 00000100:00100000:0.0:1784404908.766061:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784404908.766069:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+18:18655:x1871083728972544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404908.766081:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404908.766095:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd7a0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a0ba expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.766120:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd7a0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0ba expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.766131:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd7a0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0ba expref: 19 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.766140:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b600, rc 0) 00000100:00100000:0.0:1784404908.766226:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728972544:12345-0@lo:101:mount.lustre.0 Request processed in 157us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.766233:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784404908.768190:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404908.768221:0:18655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.768233:0:18655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784404908.769460:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784404908.771497:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404908.780499:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784404908.780998:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784404908.781021:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784404908.781036:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784404908.781050:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784404908.781063:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784404908.781090:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784404908.781096:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1784404908.781220:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404908.781296:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404908.781345:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404908.781415:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728972672 00000100:00100000:1.0:1784404908.781423:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728972672 00000100:00100000:1.0:1784404908.781474:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784404908.781484:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728972672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404908.781645:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728972672:12345-0@lo:501:mount.lustre.0 Request processed in 161us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404908.781653:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784404908.781953:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404908.781990:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404908.782041:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404908.782072:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:3.0:1784404908.782118:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728972800 00000100:00100000:3.0:1784404908.782122:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728972800 00000100:00100000:3.0:1784404908.782160:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784404908.782167:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728972800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404908.783226:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728972800:12345-0@lo:503:mount.lustre.0 Request processed in 1054us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404908.783236:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784404908.783376:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784404908.784093:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784404908.784183:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404908.784250:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404908.784375:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:3.0:1784404908.787710:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728972928 00000100:00100000:3.0:1784404908.787732:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728972928 00000100:00100000:2.0:1784404908.794324:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784404908.794342:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728972928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404908.795262:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728972928:12345-0@lo:502:mount.lustre.0 Request processed in 921us (11008us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404908.795273:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784404908.795393:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728972928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784404908.795700:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1784404908.795737:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1784404908.795752:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1784404908.795766:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1784404908.795778:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1784404908.795792:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1784404908.795805:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1784404908.795819:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1784404908.795848:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1784404908.795897:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1784404908.795910:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1784404908.795922:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1784404908.795974:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404908.796033:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.796076:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576840 going to sleep for 11 seconds 00000100:00100000:3.0:1784404908.796275:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973056 00000100:00100000:3.0:1784404908.796284:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973056 00000100:00100000:3.0:1784404908.796336:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784404908.796346:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728973056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784404908.796451:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728973056:12345-0@lo:502:mount.lustre.0 Request processed in 107us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404908.796459:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784404908.796651:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784404908.796702:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1784404908.796711:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1784404908.798504:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784404908.798582:0:18672:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1784404908.798590:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.798592:0:18672:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784404908.798601:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784404908.798616:0:18672:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dd5445fcd40) 00000020:00000080:2.0:1784404908.798642:0:18672:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784404908.798649:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784404908.799225:0:18672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd573845800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784404908.799237:0:18672:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784404908.799245:0:18672:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b3e2e6dcd7a0cf 00010000:00010000:2.0:1784404908.804459:0:18672:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1784404908.807388:0:18672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1784404908.809215:0:18672:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1784404908.811382:0:18672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784404908.811395:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404908.811401:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.811404:0:18672:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784404908.811408:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784404908.811411:0:18672:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1784404908.811413:0:18672:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784404908.811414:0:18672:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784404908.811416:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784404908.811418:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.811420:0:18672:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784404908.811422:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404908.811425:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.811426:0:18672:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784404908.811435:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784404908.811437:0:18672:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784404908.811439:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404908.811442:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.811443:0:18672:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784404908.811445:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404908.811448:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.811449:0:18672:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784404908.811451:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784404908.811483:0:18672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404908.811487:0:18672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.811488:0:18672:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784404908.811491:0:18672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1784404908.811678:0:18655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1784404908.811711:0:18655:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784404908.811737:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.811750:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404908.811759:0:18655:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd573845800 from 1 10000000:01000000:0.0:1784404908.811762:0:18655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784404908.811811:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.811820:0:18655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.812023:0:18655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404908.812051:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784404908.812122:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.812176:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443542780 going to sleep for 11 seconds 00000100:00100000:3.0:1784404908.812480:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973184 00000100:00100000:3.0:1784404908.812498:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973184 00000100:00100000:3.0:1784404908.812560:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784404908.812571:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:18655:x1871083728973184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404908.812584:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404908.812596:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a0d6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.812619:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.812630:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.812638:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6200, rc 0) 00000100:00100000:3.0:1784404908.812689:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973184:12345-0@lo:101:mount.lustre.0 Request processed in 120us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404908.812696:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784404908.812802:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404908.812836:0:18655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.812847:0:18655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404908.816729:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784404908.817288:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784404908.817452:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784404908.817477:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784404908.817494:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784404908.817499:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1784404908.817591:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404908.817661:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404908.817750:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580a3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.823774:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973312 00000100:00100000:0.0:1784404908.823793:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973312 00000100:00100000:0.0:1784404908.823902:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784404908.823915:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404908.824124:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973312:12345-0@lo:501:mount.lustre.0 Request processed in 211us (6462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.824133:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784404908.825069:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404908.825134:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784404908.825198:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404908.825956:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784404908.829591:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973440 00000100:00100000:2.0:1784404908.829607:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973440 00000100:00100000:2.0:1784404908.832443:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784404908.832470:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404908.832687:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973440:12345-0@lo:503:mount.lustre.0 Request processed in 228us (7487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404908.832696:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784404908.832887:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784404908.833394:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784404908.833500:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404908.833567:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404908.841111:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.843910:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973568 00000100:00100000:0.0:1784404908.843926:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973568 00000100:00100000:0.0:1784404908.843997:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784404908.844008:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404908.844204:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973568:12345-0@lo:502:mount.lustre.0 Request processed in 197us (10637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.844212:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784404908.844435:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784404908.844715:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784404908.844749:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784404908.844765:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784404908.844813:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784404908.844840:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784404908.844883:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784404908.844900:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784404908.844913:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1784404908.844926:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1784404908.844940:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1784404908.844966:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1784404908.845005:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404908.845057:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404908.845082:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.845903:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973696 00000100:00100000:0.0:1784404908.845913:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973696 00000100:00100000:0.0:1784404908.845959:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784404908.845967:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404908.846112:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973696:12345-0@lo:502:mount.lustre.0 Request processed in 145us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.846120:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784404908.846653:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784404908.846728:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1784404908.846739:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784404908.848738:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404908.848751:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.848760:0:18676:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784404908.848768:0:18676:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd573845800 00000020:00000080:2.0:1784404908.848770:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784404908.849317:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404908.849324:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.849326:0:18676:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784404908.849329:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404908.849333:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.849334:0:18676:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784404908.849338:0:18676:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd573845800 00000020:00000080:2.0:1784404908.849340:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784404908.849411:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404908.849415:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.849416:0:18676:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784404908.849419:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404908.849421:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.849422:0:18676:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784404908.849426:0:18676:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd573845800 00000020:00000080:2.0:1784404908.849428:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784404908.849446:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404908.849449:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.849450:0:18676:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784404908.849453:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784404908.849455:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.849456:0:18676:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784404908.849459:0:18676:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd573845800 00000020:00000080:2.0:1784404908.849461:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784404908.849487:0:18676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784404908.849491:0:18676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784404908.849493:0:18676:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784404908.849496:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1784404908.865443:0:18655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784404908.865502:0:18655:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784404908.865528:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404908.865542:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404908.865652:0:18655:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784404908.865655:0:18655:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd573845800 10000000:01000000:1.0:1784404908.865659:0:18655:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd573845800 10000000:01000000:1.0:1784404908.865666:0:18655:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784404908.865673:0:18655:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd573845800 from 1 10000000:01000000:1.0:1784404908.865676:0:18655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784404908.865713:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404908.865722:0:18655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404908.865735:0:18655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404908.865784:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784404908.865895:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404908.865947:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4431656c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.871833:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973824 00000100:00100000:0.0:1784404908.871870:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973824 00000100:00100000:0.0:1784404908.871939:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784404908.871948:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:18655:x1871083728973824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404908.871965:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404908.871988:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd7a0eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a0e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.872023:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd7a0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0e4 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.872034:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd7a0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0e4 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.872044:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151aa00, rc 0) 00000100:00100000:0.0:1784404908.872129:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728973824:12345-0@lo:101:mount.lustre.0 Request processed in 182us (6234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.872136:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784404908.872552:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404908.872571:0:18655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404908.872582:0:18655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404908.875488:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1784404908.876239:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404908.876477:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784404908.876516:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784404908.876536:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784404908.876551:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784404908.876566:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784404908.876583:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784404908.876598:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784404908.876629:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784404908.876647:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784404908.876661:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784404908.876674:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784404908.876689:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784404908.876705:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784404908.876722:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784404908.876737:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784404908.876752:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784404908.876765:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784404908.877182:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784404908.877202:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784404908.877218:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784404908.877233:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784404908.877254:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784404908.877275:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784404908.877308:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784404908.877329:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1784404908.877350:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1784404908.877369:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1784404908.877387:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1784404908.877404:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1784404908.877424:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1784404908.877444:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1784404908.877459:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1784404908.877482:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1784404908.877499:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1784404908.877767:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1784404908.878046:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1784404908.878067:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1784404908.878096:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1784404908.878104:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1784404908.878225:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404908.878306:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404908.878402:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165900 going to sleep for 11 seconds 00000100:00100000:2.0:1784404908.887535:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728973952 00000100:00100000:2.0:1784404908.887558:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728973952 00000100:00100000:0.0:1784404908.888312:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784404908.888325:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728973952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404908.888556:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728973952:12345-0@lo:501:mount.lustre.0 Request processed in 233us (10248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.888564:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784404908.888666:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728973952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404908.888723:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404908.888797:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404908.888845:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd553c6db40 going to sleep for 11 seconds 00000100:00100000:2.0:1784404908.888885:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974080 00000100:00100000:2.0:1784404908.888898:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974080 00000100:00100000:2.0:1784404908.888945:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784404908.888952:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404908.889054:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974080:12345-0@lo:503:mount.lustre.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404908.889061:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784404908.892144:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784404908.892703:0:18655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784404908.892806:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784404908.892928:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404908.892971:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.893168:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974208 00000100:00100000:0.0:1784404908.893175:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974208 00000100:00100000:0.0:1784404908.893229:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784404908.893237:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404908.893358:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974208:12345-0@lo:502:mount.lustre.0 Request processed in 120us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.893373:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784404908.893590:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784404908.893814:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784404908.893887:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784404908.893907:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784404908.893925:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784404908.893940:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784404908.893952:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784404908.893965:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784404908.893978:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784404908.893994:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784404908.894009:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784404908.894024:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784404908.894147:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784404908.894164:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784404908.894179:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784404908.894201:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784404908.894504:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784404908.894526:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784404908.894539:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784404908.894551:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784404908.894564:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784404908.894576:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784404908.894590:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784404908.894601:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784404908.894614:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784404908.894628:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1784404908.894641:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1784404908.894655:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1784404908.894682:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1784404908.894697:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1784404908.894710:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1784404908.894722:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1784404908.894735:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1784404908.894761:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1784404908.894776:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1784404908.894789:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1784404908.894801:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1784404908.894814:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1784404908.894843:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1784404908.895132:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1784404908.895152:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1784404908.895166:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1784404908.895178:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1784404908.895190:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1784404908.895361:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1784404908.895456:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1784404908.895481:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1784404908.895496:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1784404908.895510:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1784404908.895572:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784404908.895647:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404908.895717:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.902426:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974336 00000100:00100000:0.0:1784404908.902443:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974336 00000100:00100000:0.0:1784404908.902519:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784404908.902530:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404908.902743:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974336:12345-0@lo:502:mount.lustre.0 Request processed in 214us (7095us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.902752:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784404908.905936:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784404908.906278:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1784404908.906313:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1784404908.906361:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784404908.906455:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404908.906500:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.906812:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974464 00000100:00100000:0.0:1784404908.906830:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974464 00000100:00100000:0.0:1784404908.906904:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784404908.906914:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404908.907038:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728974464:12345-0@lo:502:mount.lustre.0 Request processed in 125us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.907046:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784404908.907769:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728974464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784404908.907894:0:18655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1784404908.907908:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784404908.909482:0:18681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784404908.909509:0:18681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dd573b04d40) 00000020:00000080:3.0:1784404908.909550:0:18681:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1784404908.909745:0:18681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd573845800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784404908.909749:0:18681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd573845800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784404908.909752:0:18681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd573845800 3 00010000:00080000:3.0:1784404908.909791:0:18681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd442662000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784404908.911499:0:18681:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1784404908.911606:0:18681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784404908.911649:0:18681:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784404908.911662:0:18681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x24b3e2e6dcd7a0f9 00000100:00080000:3.0:1784404908.911673:0:18681:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784404908.911679:0:18681:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd442662000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404908.911715:0:18681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d18380 x1871083728974592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404908.911748:0:18681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784404908.911803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.911807:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404908.911809:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.911812:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404908.911873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.911877:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404908.911880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.911883:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784404908.913191:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728974720:0@lo:400:kworker.0 00000100:00100000:0.0:1784404908.913277:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.913323:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404908.913331:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728975104:0@lo:400:kworker.0 00000100:00100000:0.0:1784404908.913357:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.913406:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728974848:0@lo:400:kworker.0 00000100:00100000:0.0:1784404908.913427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.913443:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404908.913447:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728974976:0@lo:400:kworker.0 00000100:00100000:0.0:1784404908.913466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.913528:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728975104 00000100:00100000:0.0:1784404908.913535:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728975104 00000100:00100000:0.0:1784404908.913575:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974848 00000100:00100000:0.0:1784404908.913579:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974848 00000100:00100000:0.0:1784404908.913602:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404908.913610:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728975104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404908.913669:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728975104:12345-0@lo:400:kworker.0 Request processed in 58us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.913677:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404908.913697:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784404908.913705:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728974848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404908.913711:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728974592:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784404908.913743:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728974848:12345-0@lo:400:kworker.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.913750:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784404908.913759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.913767:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974592 00000100:00100000:0.0:1784404908.913772:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974592 00000100:00100000:0.0:1784404908.913785:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404908.913791:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083728974592:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784404908.913813:0:17155:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00010000:00080000:1.0:1784404908.913846:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd443d1bb80 x1871083728975104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404908.913879:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728975104:0@lo:400:kworker.0 00000020:00000080:0.0:1784404908.913896:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x24b3e2e6dcd7a100 00000004:00100000:0.0:1784404908.913916:0:17155:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1784404908.913931:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974720 00000100:00100000:1.0:1784404908.913938:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974720 00000100:00080000:0.0:1784404908.913953:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9dd573227800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404908.913969:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728974976 00000100:00100000:1.0:1784404908.913973:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728974976 00000100:00100000:1.0:1784404908.913989:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784404908.913997:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728974720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404908.914006:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1871083728974592:12345-0@lo:38:llog_process_th.0 Request processed in 214us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.914014:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784404908.914046:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd443d1a680 x1871083728974848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404908.914048:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728974720:12345-0@lo:400:kworker.0 Request processed in 50us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404908.914064:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784404908.914079:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728974848:0@lo:400:kworker.0 00000100:00100000:1.0:1784404908.914081:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784404908.914091:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728974976:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1784404908.914120:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd443d18380 x1871083728974592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404908.914129:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1784404908.914135:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728974976:12345-0@lo:400:kworker.0 Request processed in 42us (664us total) trans 0 rc 0/0 00000100:00080000:0.0:1784404908.914139:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00100000:1.0:1784404908.914145:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1784404908.914148:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784404908.914155:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784404908.914157:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd442662000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784404908.914165:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083728974592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784404908.914182:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728974976:0@lo:400:kworker.0 00000100:00100000:1.0:1784404908.914212:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728974720:0@lo:400:kworker.0 00000020:01000004:3.0:1784404908.917178:0:18681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784404908.917200:0:18681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dd573b00000) 00000020:00000080:3.0:1784404908.917952:0:18681:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1784404908.918471:0:18681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd573845800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784404908.918477:0:18681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd573845800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784404908.918480:0:18681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd573845800 3 00010000:00080000:3.0:1784404908.918516:0:18681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd442660000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784404908.920817:0:18681:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1784404908.920998:0:18681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1784404908.921066:0:18681:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784404908.921089:0:18681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x24b3e2e6dcd7a10e 00000100:00080000:3.0:1784404908.921105:0:18681:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784404908.921113:0:18681:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dd442660000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404908.921161:0:18681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d1ad80 x1871083728975232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784404908.921210:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083728975232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784404908.924754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784404908.924846:0:18681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784404908.924891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.924896:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404908.924899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.924902:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404908.924905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.924908:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404908.924911:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404908.924914:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784404908.932416:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728975488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404908.932520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404908.932593:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728975488 00000100:00100000:3.0:1784404908.932602:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728975488 00000100:00100000:3.0:1784404908.932650:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784404908.932659:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728975488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404908.932706:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784404908.932756:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728975488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404908.932764:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784404908.932810:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728975488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404908.936134:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728975232 00000100:00100000:1.0:1784404908.936153:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728975232 00000100:00100000:1.0:1784404908.936211:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404908.936221:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1871083728975232:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784404908.936257:0:17154:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1784404908.936301:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x24b3e2e6dcd7a115 00000004:00100000:1.0:1784404908.936323:0:17154:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784404908.936370:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9dd4435d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404908.936480:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1871083728975232:12345-0@lo:38:llog_process_th.0 Request processed in 257us (11731us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404908.936502:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404908.937975:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728975360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404908.938045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784404908.941030:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd443d1ad80 x1871083728975232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404908.941048:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784404908.941060:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1784404908.941069:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784404908.941075:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784404908.941079:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd442660000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784404908.941086:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083728975232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784404908.941137:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728975360 00000100:00100000:2.0:1784404908.941146:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728975360 00000100:00100000:2.0:1784404908.941206:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784404908.941228:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728975360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404908.941266:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784404908.941352:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728975360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404908.941360:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784404908.941503:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728975360:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784404908.943609:0:18681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1784404908.943767:0:18655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784404908.943801:0:18655:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784404908.943836:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404908.943848:0:18655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784404908.943928:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784404908.943930:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784404908.943932:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404908.943933:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404908.943934:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404908.943936:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404908.943937:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784404908.943939:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404908.943946:0:18655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404908.943949:0:18655:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1784404908.943951:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784404908.943952:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784404908.943953:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404908.943954:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784404908.943955:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404908.943956:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404908.943957:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784404908.943958:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404908.943958:0:18655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784404908.943983:0:18655:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784404908.944006:0:18655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728975616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784404908.944084:0:18655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404908.944122:0:18655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404908.944142:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728975616 00000100:00100000:2.0:1784404908.944148:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728975616 00000100:00100000:2.0:1784404908.944198:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784404908.944206:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728975616:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784404908.944242:0:17147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784404908.944256:0:17147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784404908.962356:0:17147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784404908.962381:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784404908.962610:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784404908.962616:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784404908.962640:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404908.962660:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404908.962669:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404908.962678:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404908.962738:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404908.962752:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 21 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404908.962767:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728975744:0@lo:104: 00000100:00100000:2.0:1784404908.962895:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784404908.962945:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404908.962955:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 21 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404908.962964:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728975872:0@lo:104: 00000100:00100000:2.0:1784404908.962990:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404908.963012:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd54a5593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404908.963026:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784404908.963041:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728975744 00000100:00100000:0.0:1784404908.963047:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728975744 00000100:00100000:0.0:1784404908.963078:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728975872 00000100:00100000:0.0:1784404908.963079:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728975872 00000100:00100000:0.0:1784404908.963091:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784404908.963098:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:17169:x1871083728975744:12345-0@lo:104: 00010000:00010000:0.0:1784404908.963109:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963204:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784404908.963210:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:17169:x1871083728975744:12345-0@lo:104: Request processed in 112us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.963215:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784404908.963229:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404908.963233:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57de8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728975872:12345-0@lo:104: 00010000:00010000:0.0:1784404908.963243:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963267:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784404908.963271:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57de8f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728975872:12345-0@lo:104: Request processed in 38us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.963275:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1784404908.963308:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404908.963313:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963318:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404908.963322:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963331:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404908.963339:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404908.963345:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404908.963379:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963386:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404908.963410:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963418:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151a200/0x24b3e2e6dcd7a06d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a074 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963436:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404908.963439:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963445:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151be00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404908.963448:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963454:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404908.963460:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404908.963466:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784404908.963491:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404908.963493:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:18655:x1871083728975616:12345-0@lo:253:mount.lustre.0 Request processed in 19287us (19408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404908.963511:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1784404908.963516:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404908.963538:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963546:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a05f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a066 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963559:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404908.963561:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404908.963563:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404908.963567:0:18655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:18655:1871083728975616:0@lo:253:mount.lustre.0 00010000:00010000:0.0:1784404908.963572:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784404908.963580:0:18655:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784404908.963585:0:18655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784404908.963587:0:18655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784404908.963588:0:18655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784404908.963590:0:18655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1784404908.963592:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728976128:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1784404908.963593:0:18655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784404908.963596:0:18655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784404908.963599:0:18655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784404908.963608:0:18655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784404908.963610:0:18655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784404908.963624:0:18655:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784404908.963631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.963675:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976128 00000100:00100000:0.0:1784404908.963679:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976128 00010000:00010000:0.0:1784404908.963697:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 21 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404908.963721:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784404908.963728:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3648:x1871083728976128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404908.963739:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404908.963745:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 21 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963756:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 21 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.963788:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404908.963833:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3648:x1871083728976128:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.963840:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784404908.963902:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728976128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404908.964664:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728975744:0@lo:104: 00010000:00010000:3.0:1784404908.964672:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516ec00/0x24b3e2e6dcd7a066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a05f expref: 20 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404908.964680:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728975872:0@lo:104: 00010000:00010000:3.0:1784404908.964698:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404908.964723:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728976000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404908.964763:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404908.965102:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976000 00000100:00100000:0.0:1784404908.965107:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976000 00010000:00010000:0.0:1784404908.965125:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 20 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404908.965149:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404908.965154:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:3647:x1871083728976000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784404908.965168:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784404908.965171:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 20 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965178:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 20 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965188:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516f400/0x24b3e2e6dcd7a074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a06d expref: 20 pid: 17146 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965197:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965203:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784404908.965213:0:17141:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002712274s 00010000:00010000:0.0:1784404908.965215:0:17141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965220:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965224:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965228:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965232:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404908.965234:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965243:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.965347:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404908.965355:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965388:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965393:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516f800/0x24b3e2e6dcd7a11c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404908.965403:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784404908.965458:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3647:x1871083728976000:12345-0@lo:103:ldlm_bl.0 Request processed in 303us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404908.965463:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784404908.965529:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728976000:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1784404908.965737:0:18655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784404908.967645:0:18655:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784404908.967654:0:18655:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784404908.967690:0:18655:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784404908.967731:0:18655:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784404908.967753:0:18655:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784404908.968016:0:18655:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1784404908.969788:0:18655:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784404908.970103:0:18655:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784404909.380597:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784404909.772651:0:18735:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784404909.773216:0:18735:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1784404910.022218:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784404910.404302:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784404910.722931:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784404910.722938:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442285000 from 9 10000000:01000000:1.0:1784404910.722943:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784404910.722984:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404910.722997:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404910.723008:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404910.723032:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404910.723096:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404910.723140:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd553c53000 going to sleep for 11 seconds 00000100:00100000:0.0:1784404910.723210:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976256 00000100:00100000:0.0:1784404910.723218:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976256 00000100:00100000:0.0:1784404910.723266:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784404910.723275:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:17151:x1871083728976256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404910.723299:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404910.723312:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a123 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404910.723344:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404910.723354:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404910.723362:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a000, rc 0) 00000100:00100000:0.0:1784404910.723410:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:17151:x1871083728976256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404910.723417:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784404910.723680:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404910.723694:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404910.723703:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404910.723755:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784404910.723783:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404910.723813:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784404910.723951:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976384 00000100:00100000:0.0:1784404910.723955:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976384 00000100:00100000:0.0:1784404910.723983:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784404910.723989:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:17151:x1871083728976384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784404910.724001:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784404910.724014:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784404910.724017:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1784404910.724085:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:17151:x1871083728976384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404910.724091:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784404910.724176:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784404910.724225:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784404910.724231:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404910.724238:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404910.724247:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784404910.724249:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd443e83000 from 9 10000000:01000000:3.0:1784404910.724251:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784404910.724265:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404910.724277:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404910.724285:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404910.724307:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404910.724330:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404910.724352:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404910.724436:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976512 00000100:00100000:1.0:1784404910.724440:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976512 00000100:00100000:1.0:1784404910.724468:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784404910.724474:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:17151:x1871083728976512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404910.724481:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404910.724489:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a131 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404910.724512:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404910.724521:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404910.724528:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759a00, rc 0) 00000100:00100000:1.0:1784404910.724563:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728976512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404910.724568:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784404910.724779:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404910.724789:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404910.724797:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404910.724877:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784404910.724904:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404910.724912:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3240 going to sleep for 11 seconds 00000100:00100000:1.0:1784404910.725024:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976640 00000100:00100000:1.0:1784404910.725028:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976640 00000100:00100000:1.0:1784404910.725054:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784404910.725060:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728976640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784404910.725069:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784404910.725080:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784404910.725083:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1784404910.725140:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728976640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404910.725146:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784404910.726428:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728976640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784404910.726508:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784404910.726518:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404910.726528:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404911.427073:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404912.454525:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404913.475872:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404914.054590:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728976768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404914.054667:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404914.054788:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976768 00000100:00100000:3.0:1784404914.054797:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976768 00000100:00100000:3.0:1784404914.054873:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784404914.054883:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728976768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404914.054920:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784404914.054984:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728976768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404914.054992:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784404914.055165:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728976768:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1784404914.055191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404914.055195:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404914.055199:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404914.055202:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404914.055223:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404914.055227:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404914.055229:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404914.055233:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784404914.055256:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728977152:0@lo:400:kworker.0 00000100:00100000:0.0:1784404914.055305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404914.055333:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404914.055339:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728977280:0@lo:400:kworker.0 00000100:00100000:0.0:1784404914.055361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404914.055382:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977152 00000100:00100000:2.0:1784404914.055386:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977152 00000100:00100000:0.0:1784404914.055388:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977280 00000100:00100000:0.0:1784404914.055391:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977280 00000100:00100000:2.0:1784404914.055417:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784404914.055424:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728977152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404914.055460:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728977152:12345-0@lo:400:kworker.0 Request processed in 37us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404914.055466:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404914.055523:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728976896:0@lo:400:kworker.0 00000100:00100000:3.0:1784404914.055555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404914.055580:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728977408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404914.055605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404914.055624:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784404914.055629:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728977024:0@lo:400:kworker.0 00000100:00100000:3.0:1784404914.055651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404914.055668:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728977536:0@lo:400:kworker.0 00000100:00100000:3.0:1784404914.055687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404914.055712:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977408 00000100:00100000:3.0:1784404914.055715:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977408 00000100:00100000:0.0:1784404914.063179:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977536 00000100:00100000:0.0:1784404914.063195:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977536 00000100:00100000:0.0:1784404914.063244:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784404914.063254:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728977280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404914.063345:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728977280:12345-0@lo:400:kworker.0 Request processed in 93us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404914.063352:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784404914.063370:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404914.063377:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728977536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404914.063419:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728977536:12345-0@lo:400:kworker.0 Request processed in 43us (7731us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404914.063426:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404914.067516:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728977664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404914.067601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784404914.067676:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ff9180 x1871083728977280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404914.067691:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728977280:0@lo:400:kworker.0 00010000:00080000:0.0:1784404914.067705:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ff8a80 x1871083728977152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404914.067713:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728977152:0@lo:400:kworker.0 00000100:00100000:2.0:1784404914.067739:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977024 00000100:00100000:2.0:1784404914.067745:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977024 00000100:00100000:0.0:1784404914.067771:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728976896 00000100:00100000:0.0:1784404914.067787:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728976896 00000100:00100000:2.0:1784404914.067795:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977664 00000100:00100000:2.0:1784404914.067798:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977664 00000100:00100000:2.0:1784404914.067811:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404914.067816:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784404914.067819:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083728977024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404914.067821:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3646:x1871083728976896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404914.067947:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404914.067965:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728977408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404914.072116:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3646:x1871083728976896:12345-0@lo:400:kworker.0 Request processed in 4282us (16548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404914.072132:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784404914.072216:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784404914.072229:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728977664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404914.072266:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784404914.072333:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083728977664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (4732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404914.072338:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784404914.072394:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728977664:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1784404914.072440:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ff8700 x1871083728977536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404914.072452:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728977536:0@lo:400:kworker.0 00000100:00100000:0.0:1784404914.072461:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728976896:0@lo:400:kworker.0 00000100:00100000:2.0:1784404914.072664:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728977024:12345-0@lo:400:kworker.0 Request processed in 4845us (17010us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404914.072834:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404914.072913:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728977024:0@lo:400:kworker.0 00000100:00100000:3.0:1784404914.073184:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728977408:12345-0@lo:400:kworker.0 Request processed in 5227us (17575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404914.073195:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1784404914.073248:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404914.073253:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784404914.073322:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ff9f80 x1871083728977408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404914.073333:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728977408:0@lo:400:kworker.0 00010000:00010000:0.0:1784404914.499035:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404915.524024:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784404915.765524:0:19025:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1784404915.907599:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784404916.565643:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784404916.982103:0:19077:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404916.982382:0:19077:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404917.571153:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784404917.824314:0:19127:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784404917.824915:0:19127:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784404918.148281:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404903/real 1784404903] req@ffff9dd577ff9c00 x1871083728971904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404918 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404918.148336:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd577ff9c00 x1871083728971904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404918 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404918.148347:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404903/real 1784404903] req@ffff9dd577ff8380 x1871083728972032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404918 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404918.148358:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd577ff8380 x1871083728972032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404918 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784404918.148378:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404918.148407:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784404918.148411:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728971904:0@lo:8:kworker.0 00000100:00080000:0.0:1784404918.148416:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404918.148421:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784404918.148424:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728972032:0@lo:8:kworker.0 00000100:00080000:3.0:1784404918.148925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404918.148931:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404918.148934:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404918.148938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784404918.148967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404918.148972:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784404918.148975:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404918.148982:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1784404918.148988:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784404918.148996:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd443583000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404918.149018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242fb80 x1871083728978304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404918.149031:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404918.149035:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784404918.149037:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404918.149040:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1784404918.149042:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784404918.149045:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd548765000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404918.149056:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242c380 x1871083728978432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784404918.149097:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728978048:0@lo:400:kworker.0 00000100:00100000:1.0:1784404918.149125:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728978176:0@lo:400:kworker.0 00000100:00100000:0.0:1784404918.149205:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728977792:0@lo:400:kworker.0 00000100:00100000:2.0:1784404918.151280:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728977920:0@lo:400:kworker.0 00000100:00100000:1.0:1784404918.152538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404918.153208:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978176 00000100:00100000:1.0:1784404918.153220:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978176 00000100:00100000:1.0:1784404918.153283:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404918.153294:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728978176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404918.153448:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728978176:12345-0@lo:400:kworker.0 Request processed in 156us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404918.153455:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404918.153505:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728978176:0@lo:400:kworker.0 00000100:00100000:3.0:1784404918.159914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404918.160463:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978048 00000100:00100000:1.0:1784404918.160475:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978048 00000100:00100000:1.0:1784404918.160541:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404918.160552:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728978048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404918.160635:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728978048:12345-0@lo:400:kworker.0 Request processed in 85us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404918.160658:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404918.160722:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728978304:0@lo:8:kworker.0 00000100:00100000:1.0:1784404918.160775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404918.160817:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728978432:0@lo:8:kworker.0 00000100:00100000:1.0:1784404918.160841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404918.160930:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978304 00000100:00100000:1.0:1784404918.160934:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978304 00000100:00100000:1.0:1784404918.160950:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978432 00000100:00100000:1.0:1784404918.160953:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978432 00000100:00100000:1.0:1784404918.160963:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404918.160969:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728978304:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784404918.160999:0:18660:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1784404918.161035:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a13f 00002000:00100000:1.0:1784404918.161048:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dd4435d6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1784404918.161053:0:18660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1784404918.161055:0:18660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784404918.161235:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1784404918.161260:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9dd4435d0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404918.161300:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083728978304:12345-0@lo:8:kworker.0 Request processed in 330us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404918.161307:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784404918.161320:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404918.161339:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728978432:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784404918.161353:0:18660:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784404918.162525:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784404918.162564:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443d1ad80 x1871083728978048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404918.162569:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728978560:0@lo:400:kworker.0 00000100:00100000:3.0:1784404918.162581:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728978048:0@lo:400:kworker.0 00000100:00100000:3.0:1784404918.162588:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728978816:0@lo:400:kworker.0 00000100:00100000:0.0:1784404918.162595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404918.162610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404918.162650:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978560 00000100:00100000:0.0:1784404918.162653:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977792 00000100:00100000:3.0:1784404918.162655:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978560 00000100:00100000:0.0:1784404918.162655:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977792 00000100:00100000:3.0:1784404918.162684:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978816 00000100:00100000:3.0:1784404918.162687:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978816 00000100:00100000:0.0:1784404918.162687:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784404918.162693:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3649:x1871083728977792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404918.162712:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404918.162716:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728978560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404918.162765:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083728978560:12345-0@lo:400:kworker.0 Request processed in 46us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404918.162765:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3649:x1871083728977792:12345-0@lo:400:kworker.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404918.162772:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784404918.162772:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784404918.162785:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404918.162791:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728978816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404918.162808:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728977792:0@lo:400:kworker.0 00000100:00100000:3.0:1784404918.162820:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728978816:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00010000:00080000:0.0:1784404918.162820:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242ca80 x1871083728978560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404918.162825:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784404918.162829:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083728978560:0@lo:400:kworker.0 00000100:00080000:3.0:1784404918.162842:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784404918.162877:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242dc00 x1871083728978816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784404918.162880:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242fb80 x1871083728978304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404918.162887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728978816:0@lo:400:kworker.0 00000100:00100000:0.0:1784404918.162889:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784404918.162895:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1784404918.162903:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784404918.162909:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784404918.162912:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784404918.162924:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784404918.162929:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728978304:0@lo:8:kworker.0 00000100:00100000:2.0:1784404918.163211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404918.163234:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728978688:0@lo:400:kworker.0 00000100:00100000:2.0:1784404918.163259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784404918.163296:0:17894:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784404918.163461:0:17894:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 536047608758ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784404918.163468:0:17894:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784404918.163496:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978688 00000100:00100000:2.0:1784404918.163501:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978688 00000100:00100000:2.0:1784404918.163530:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784404918.163536:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728978688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404918.163574:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728978688:12345-0@lo:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404918.163580:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1784404918.163607:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242ea00 x1871083728978688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404918.163618:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728978688:0@lo:400:kworker.0 00000100:00080000:2.0:1784404918.163711:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404918.164032:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728977920 00000100:00100000:0.0:1784404918.164037:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728977920 00000100:00100000:0.0:1784404918.164066:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784404918.164072:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728977920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404918.164113:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728977920:12345-0@lo:400:kworker.0 Request processed in 41us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404918.164119:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784404918.168593:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728977920:0@lo:400:kworker.0 00000004:00080000:3.0:1784404918.173181:0:17895:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1784404918.173253:0:17895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17895:1871083728979072:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1784404918.173330:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404918.173364:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728978944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404918.173376:0:18661:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784404918.173382:0:18661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784404918.173400:0:17895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c130c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404918.173403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404918.173434:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728978944 00000100:00100000:3.0:1784404918.173441:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728978944 00000100:00100000:3.0:1784404918.173498:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404918.173506:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1871083728978944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404918.173533:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784404918.173585:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1871083728978944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404918.173592:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1784404918.173612:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404918.173628:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979072 00000100:00100000:3.0:1784404918.173632:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979072 00010000:00080000:0.0:1784404918.173680:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242dc00 x1871083728978944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404918.173700:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728978944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404918.173714:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784404918.173720:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17895:x1871083728979072:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1784404918.175194:0:17886:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1784404918.176298:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728978432:12345-0@lo:8:kworker.0 Request processed in 14964us (15448us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404918.176313:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784404918.176815:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784404918.176823:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784404918.176828:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728978432:0@lo:8:kworker.0 00002000:00080000:0.0:1784404918.184472:0:19139:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1784404918.184483:0:19139:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1784404918.184593:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17895:x1871083728979072:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10868us (11259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404918.184607:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784404918.184808:0:17895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242e300 x1871083728979072/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784404934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404918.184824:0:17895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17895:1871083728979072:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1784404918.184837:0:17895:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1784404918.184910:0:17895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17895:1871083728979200:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1784404918.184946:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404918.184975:0:17895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c130c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404918.185443:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979200 00000100:00100000:0.0:1784404918.185450:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979200 00000100:00100000:0.0:1784404918.185500:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784404918.185510:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17895:x1871083728979200:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1784404918.185535:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1784404918.185596:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17895:x1871083728979200:12345-0@lo:5:osp-pre-0-1.0 Request processed in 87us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404918.185603:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784404918.187102:0:17895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242e300 x1871083728979200/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404918.187142:0:17895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17895:1871083728979200:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1784404918.187156:0:17895:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1784404918.187214:0:17895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17895:1871083728979328:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1784404918.187264:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404918.187299:0:17895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404918.187337:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979328 00000100:00100000:1.0:1784404918.187345:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979328 00000100:00100000:1.0:1784404918.187395:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404918.187405:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17895:x1871083728979328:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1784404918.187442:0:18660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1784404918.211680:0:18656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1784404918.211702:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1784404918.213166:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17895:x1871083728979328:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25751us (25890us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784404918.213199:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784404918.213655:0:17895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ff9880 x1871083728979328/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404918.213669:0:17895:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784404918.213675:0:17895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17895:1871083728979328:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784404918.213697:0:17895:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1784404918.213772:0:17895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17895:1871083728979456:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1784404918.213816:0:17895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404918.213876:0:17895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548028180 going to sleep for 11 seconds 00000100:00100000:3.0:1784404918.214083:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979456 00000100:00100000:3.0:1784404918.214091:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979456 00000100:00100000:3.0:1784404918.214142:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404918.214152:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17895:x1871083728979456:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1784404918.214211:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17895:x1871083728979456:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404918.214218:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784404918.214406:0:17895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443631f80 x1871083728979456/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784404934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404918.214418:0:17895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17895:1871083728979456:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1784404918.596056:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404919.171302:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404919.171325:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728979584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404919.171397:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404919.171444:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979584 00000100:00100000:1.0:1784404919.171453:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979584 00000100:00100000:1.0:1784404919.171515:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404919.171524:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728979584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404919.171560:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784404919.171604:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728979584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404919.171611:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784404919.171656:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728979584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404919.171844:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404919.171876:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728979712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404919.171909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404919.172252:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979712 00000100:00100000:0.0:1784404919.172257:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979712 00000100:00100000:0.0:1784404919.172296:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784404919.172304:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728979712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404919.172327:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784404919.172369:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728979712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404919.172377:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784404919.172551:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728979712:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784404919.620136:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784404920.259590:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784404920.643025:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404921.678209:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404922.692671:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404923.267112:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404903/real 1784404903] req@ffff9dd577ffb480 x1871083728971392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404923 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404923.267144:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd577ffb480 x1871083728971392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404923 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404923.267154:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404903/real 1784404903] req@ffff9dd577ffb800 x1871083728971520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404923 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404923.267166:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd577ffb800 x1871083728971520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784404923 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784404923.267187:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404923.267207:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784404923.267211:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728971392:0@lo:8:kworker.0 00000100:00080000:2.0:1784404923.267217:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404923.267221:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784404923.267225:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728971520:0@lo:8:kworker.0 00000100:00100000:0.0:1784404923.267369:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728979840:0@lo:400:kworker.0 00000100:00100000:0.0:1784404923.267458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784404923.267583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404923.267588:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784404923.267591:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404923.267595:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1784404923.267600:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784404923.267607:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd44319c800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404923.267628:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242d880 x1871083728980096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784404923.267639:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404923.267642:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784404923.267643:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404923.267657:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1784404923.267660:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784404923.267663:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd441a60000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404923.267674:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242e680 x1871083728980224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404923.267750:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979840 00000100:00100000:1.0:1784404923.267757:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979840 00000100:00100000:1.0:1784404923.267808:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784404923.267817:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3647:x1871083728979840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404923.268133:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728980480:0@lo:400:kworker.0 00000100:00100000:2.0:1784404923.268180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404923.268229:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980480 00000100:00100000:2.0:1784404923.268234:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980480 00000100:00100000:2.0:1784404923.268266:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784404923.268273:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728980480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404923.268317:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728980480:12345-0@lo:400:kworker.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404923.268325:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784404923.268372:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728980480:0@lo:400:kworker.0 00000100:00100000:2.0:1784404923.268406:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728980096:0@lo:8:kworker.0 00000100:00100000:2.0:1784404923.268435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404923.268464:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728980224:0@lo:8:kworker.0 00000100:00100000:2.0:1784404923.268485:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404923.268519:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980096 00000100:00100000:2.0:1784404923.268523:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980096 00000100:00100000:2.0:1784404923.268541:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980224 00000100:00100000:2.0:1784404923.268543:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980224 00000100:00100000:2.0:1784404923.268558:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784404923.268563:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1871083728980096:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784404923.268590:0:18661:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:2.0:1784404923.268618:0:18661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a146 00002000:00100000:2.0:1784404923.268631:0:18661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dd5441d5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784404923.268635:0:18661:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784404923.268638:0:18661:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784404923.268748:0:18661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784404923.268772:0:18661:0:(import.c:65:import_set_state_nolock()) ffff9dd5441d0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404923.268811:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083728980096:12345-0@lo:8:kworker.0 Request processed in 247us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404923.268830:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784404923.268845:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784404923.268871:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1871083728980224:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784404923.268883:0:18661:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1784404923.271225:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784404923.271233:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784404923.271238:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784404923.271249:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1784404923.271257:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784404923.271265:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd548765000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784404923.271289:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd44242c380 x1871083728980736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784404923.271373:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728979968:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.271462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404923.271497:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728980864:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.271522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404923.271542:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784404923.271549:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728980352:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.271572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404923.271590:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728980992:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.271609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404923.271664:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728979968 00000100:00100000:3.0:1784404923.271673:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728979968 00000100:00100000:3.0:1784404923.271735:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784404923.271759:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728979968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.271816:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728979968:12345-0@lo:400:kworker.0 Request processed in 58us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404923.271824:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784404923.271847:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980864 00000100:00100000:3.0:1784404923.271870:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980864 00000100:00100000:3.0:1784404923.271904:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980352 00000100:00100000:3.0:1784404923.271907:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980352 00000100:00100000:3.0:1784404923.271919:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980992 00000100:00100000:3.0:1784404923.271922:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980992 00000100:00100000:3.0:1784404923.271948:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784404923.271955:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728980864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.271985:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728980864:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404923.271991:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784404923.272001:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784404923.272007:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728980352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272029:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728980352:12345-0@lo:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404923.272034:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784404923.272043:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784404923.272049:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728980992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272072:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728980992:12345-0@lo:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404923.272078:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1784404923.272100:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784404923.272126:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242f800 x1871083728980352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404923.272150:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728980352:0@lo:400:kworker.0 00010000:00080000:3.0:1784404923.272164:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242ea00 x1871083728980992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404923.272171:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728980992:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272181:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728979968:0@lo:400:kworker.0 00010000:00080000:3.0:1784404923.272189:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242dc00 x1871083728980864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404923.272196:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728980864:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272233:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728981120:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404923.272276:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404923.272281:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728980608:0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404923.272331:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980608 00000100:00100000:3.0:1784404923.272334:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980608 00000100:00100000:3.0:1784404923.272361:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784404923.272368:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728980608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272403:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728980608:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404923.272410:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1784404923.272427:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404923.272433:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728981120 00000100:00100000:3.0:1784404923.272436:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728981120 00000100:00100000:3.0:1784404923.272468:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784404923.272474:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728981120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404923.272503:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728981120:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404923.272509:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1784404923.272524:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784404923.272538:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242e300 x1871083728980608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784404939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404923.272548:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728980608:0@lo:400:kworker.0 00010000:00080000:3.0:1784404923.272557:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242fb80 x1871083728981120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404923.272564:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728981120:0@lo:400:kworker.0 00000100:00100000:1.0:1784404923.279549:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3647:x1871083728979840:12345-0@lo:400:kworker.0 Request processed in 11717us (12074us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404923.279568:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784404923.281000:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728980736:0@lo:8:kworker.0 00000100:00100000:1.0:1784404923.281079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784404923.281148:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242d880 x1871083728980096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404923.281160:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784404923.281170:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784404923.281180:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784404923.281186:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784404923.281190:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784404923.281205:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784404923.281211:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728980096:0@lo:8:kworker.0 00000004:00080000:1.0:1784404923.281254:0:17177:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784404923.281350:0:17177:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 541165497517ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784404923.281357:0:17177:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784404923.283480:0:17178:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1784404923.283508:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1871083728981504:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784404923.283585:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404923.283622:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784404923.283663:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728981376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404923.283689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404923.283748:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728980736 00000100:00100000:2.0:1784404923.283756:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728980736 00000100:00100000:2.0:1784404923.283790:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728981504 00000100:00100000:2.0:1784404923.283793:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728981504 00000100:00100000:2.0:1784404923.283834:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784404923.283841:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728980736:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784404923.283892:0:18660:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784404923.283937:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728980736:12345-0@lo:8:kworker.0 Request processed in 94us (2857us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784404923.283944:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784404923.283967:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784404923.283973:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17178:x1871083728981504:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1784404923.284222:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404923.284442:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404923.284448:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404923.284459:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728980736:0@lo:8:kworker.0 00000100:00100000:2.0:1784404923.284524:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1871083728980224:12345-0@lo:8:kworker.0 Request processed in 15673us (16038us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784404923.284532:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1784404923.284557:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404923.284562:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404923.284564:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728980224:0@lo:8:kworker.0 00000100:00100000:1.0:1784404923.284927:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728981376 00000100:00100000:1.0:1784404923.284934:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728981376 00000100:00100000:1.0:1784404923.284972:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404923.284980:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083728981376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784404923.285006:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784404923.285119:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083728981376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404923.285126:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784404923.285279:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404923.285297:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728981248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404923.285344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404923.285371:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728981248 00000100:00100000:1.0:1784404923.285375:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728981248 00000100:00100000:1.0:1784404923.285398:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784404923.285404:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728981248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404923.285422:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784404923.285451:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728981248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404923.285471:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784404923.285501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443cde300 x1871083728981248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404923.285517:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728981248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404923.288560:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728979840:0@lo:400:kworker.0 00010000:00080000:2.0:1784404923.291200:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ff8380 x1871083728981376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404923.291228:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728981376:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784404923.293774:0:17134:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1784404923.308616:0:18660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1784404923.308628:0:18660:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1784404923.308636:0:18660:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:1.0:1784404923.321415:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.321433:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321452:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.321456:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.321463:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321481:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321490:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321497:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321531:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784404923.321544:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404923.321550:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321558:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404923.321562:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321570:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321588:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321594:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a14d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.321611:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404923.321612:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404923.321614:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.326296:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.326314:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.326333:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.326354:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.326362:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.326378:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.326388:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.326396:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.326423:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.327177:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.327187:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.327197:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.327211:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.327221:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.327245:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.327252:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a154 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.327288:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.327291:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.327292:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.327484:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.327536:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.327546:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.327550:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.327555:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.327566:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.327575:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.327589:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.327614:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.331083:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.331101:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.331117:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758c00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.331122:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.331134:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.331156:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.331186:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a15b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.331216:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.331218:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.331220:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.331563:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.331572:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.331584:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.331589:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.331597:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.331609:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.331618:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.331626:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.331656:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.332243:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.332250:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.332272:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.332276:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.332284:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.332302:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.332310:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a162 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.332329:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.332331:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.332333:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.333354:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.333364:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.333386:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.333391:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.333397:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.333411:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.333421:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.333428:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.333452:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784404923.336791:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.336809:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.336833:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.336838:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.336844:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.336872:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.336889:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.336895:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.336908:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784404923.337580:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404923.337591:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337600:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.337604:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337611:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337627:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337631:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a169 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337651:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.337653:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337657:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.337659:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337664:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337679:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337684:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.337692:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.337703:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.337705:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.337711:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.338830:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.338885:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.338901:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.338906:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.338912:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.338926:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.338936:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.338945:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.338985:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.339270:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.339277:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.339286:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.339290:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.339299:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.339315:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.339323:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a177 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.339349:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.339351:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.339353:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.340000:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.340007:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.340018:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.340022:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.340026:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.340037:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.340045:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.340053:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.341379:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.341594:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.341603:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.341615:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.341619:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.341629:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.341647:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.341655:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a17e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.341674:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.341676:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.341678:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.343011:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.343021:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.343034:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.343044:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.343051:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.343065:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.343075:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.343083:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.343103:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.343373:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.343379:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.343398:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167f000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.343402:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.343411:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.343426:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.343434:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a185 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.343451:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.343452:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.343454:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.345542:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.345555:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.345572:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.345576:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.345582:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.345597:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.345607:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.345621:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.345649:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.345889:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.345896:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.345905:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167fc00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.345910:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.345918:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.345943:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.345949:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a18c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.345963:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.345964:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.345965:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.349174:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.349191:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.349208:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.349213:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.349220:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.349235:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.349247:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.349262:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.349289:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.349563:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.349572:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.349580:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.349586:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.349596:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.349616:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.349623:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a193 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.349656:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.349659:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.349661:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.352739:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.352752:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.352778:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.352782:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.352788:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.352801:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.352810:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.352818:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.352832:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.353135:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.353143:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.353151:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.353155:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.353164:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.353181:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.353188:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a19a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.353203:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.353205:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.353206:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.354744:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.354756:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.354774:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.354779:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.354784:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.354797:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.354820:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.354827:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.354874:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.354940:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.354946:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.354966:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.354969:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.354978:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.354994:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.355001:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a1a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.355019:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.355020:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.355022:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.355609:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.355617:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.355627:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.355630:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.355635:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.355645:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.355654:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.355662:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.355703:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.355724:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.355729:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.355737:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167f000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.355741:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.355748:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.355767:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.355774:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a1a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.355788:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.355789:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.355791:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.357616:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.357630:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.357647:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.357651:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.357656:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.357669:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.357678:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.357686:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.357716:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.357746:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.357753:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.357762:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.357767:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.357774:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.357791:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.357798:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cd400f1/0x24b3e2e6dcd7a1af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.357910:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.357913:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.357915:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.358574:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.358582:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.358593:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.358606:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.358610:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.358620:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.358629:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.358635:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.358656:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.358688:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.358706:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.358713:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.358717:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.358725:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.358737:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.358745:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cf54156/0x24b3e2e6dcd7a1b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.358759:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.358761:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.358762:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.359586:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.359594:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.359606:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.359609:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.359614:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.359625:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.359633:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.359648:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.359676:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.359707:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.359712:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.359730:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.359734:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.359741:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.359754:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.359761:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000613f790b/0x24b3e2e6dcd7a1bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.359776:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.359778:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.359779:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.360375:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.360390:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.360400:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.360403:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.360416:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.360427:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.360435:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.360442:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.360464:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.360767:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.360774:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.360782:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.360786:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.360794:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.360814:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.360821:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f0dc748/0x24b3e2e6dcd7a1c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.360870:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.360872:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.360875:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.361413:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.361420:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.361439:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.361443:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.361448:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.361459:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.361467:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.361474:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.361743:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784404923.362194:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.362201:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.362211:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.362214:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.362219:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.362229:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.362248:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.362267:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.362292:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784404923.362526:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404923.362532:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362541:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758c00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404923.362545:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362554:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362573:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362581:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471140f3/0x24b3e2e6dcd7a1cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362612:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404923.362616:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362623:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404923.362626:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362634:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362645:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362652:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090a051ad/0x24b3e2e6dcd7a1d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.362666:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404923.362667:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404923.362669:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.362939:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.363162:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.363167:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.363177:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.363181:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.363185:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.363195:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.363202:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.363209:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.363240:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404923.363298:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404923.363303:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.363311:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404923.363321:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.363329:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.363340:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.363352:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff9bfad4/0x24b3e2e6dcd7a1d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404923.363366:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404923.363367:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404923.363369:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.364049:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.364056:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364065:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.364069:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.364073:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364082:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364089:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364095:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364117:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784404923.364447:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.364452:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364461:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.364470:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.364475:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364485:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364500:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364506:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364521:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784404923.364906:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.364912:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364921:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.364924:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.364929:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364939:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364946:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364958:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.364966:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784404923.365287:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.365293:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365301:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.365304:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.365307:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365317:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365325:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365332:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365340:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784404923.365639:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.365644:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365657:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.365659:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.365664:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365671:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365678:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365685:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.365704:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784404923.366000:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784404923.366008:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366016:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.366021:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366030:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366047:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366055:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b687a08/0x24b3e2e6dcd7a1e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366085:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784404923.366089:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366096:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540030600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.366099:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366106:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784404923.366111:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.366117:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366117:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.366125:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=541s v=(0 0) 00010000:00010000:0.0:1784404923.366125:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000833a6148/0x24b3e2e6dcd7a1e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.366128:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.366133:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366138:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784404923.366142:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366142:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366150:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.366153:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.366161:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.366168:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366171:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.366177:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784404923.366180:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366186:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048dc8739/0x24b3e2e6dcd7a1ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366198:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784404923.366202:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366208:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031a00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.366211:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366219:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366228:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366235:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0938c26/0x24b3e2e6dcd7a1f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366257:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404923.366260:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366267:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540030800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.366270:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366277:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366287:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366295:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003acf50b1/0x24b3e2e6dcd7a1fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366307:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.366310:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366316:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540030000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.366320:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366338:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366349:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366357:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0840cbc/0x24b3e2e6dcd7a203 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.366369:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.366381:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.366384:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404923.368171:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404923.368183:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.368200:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784404923.368205:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404923.368211:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.368223:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.368234:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.368243:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404923.368284:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404923.368297:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404923.368304:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.368312:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404923.368316:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.368324:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.368340:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784404923.368356:0:18660:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:0.0:1784404923.368356:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089aaf8d6/0x24b3e2e6dcd7a20a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404923.368372:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.368373:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404923.368375:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404923.368687:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17178:x1871083728981504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 84710us (85099us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404923.368709:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784404923.369179:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1871083728981504:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784404923.369196:0:17178:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1784404923.369245:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1871083728981632:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784404923.369283:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404923.369306:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574eb3480 going to sleep for 11 seconds 00010000:00010000:2.0:1784404923.369320:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404923.369926:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728981632 00000100:00100000:1.0:1784404923.369937:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728981632 00000100:00100000:2.0:1784404923.370526:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404923.370539:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17178:x1871083728981632:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784404923.370585:0:19139:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1784404923.387483:0:18656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1784404923.387538:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784404923.387838:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17178:x1871083728981632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17295us (18547us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784404923.387880:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404923.387926:0:17178:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1784404923.387935:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17178:1871083728981632:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784404923.387952:0:17178:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1784404923.718084:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404924.291022:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728981760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404924.291098:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404924.291155:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728981760 00000100:00100000:1.0:1784404924.291162:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728981760 00000100:00100000:1.0:1784404924.291209:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404924.291218:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728981760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404924.291254:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784404924.291298:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728981760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404924.291305:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404924.291350:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728981760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404924.298308:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728981888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404924.298384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404924.299613:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728981888 00000100:00100000:1.0:1784404924.299626:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728981888 00000100:00100000:1.0:1784404924.299682:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784404924.299705:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728981888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404924.299754:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784404924.302801:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728981888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3090us (4409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404924.302815:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784404924.303696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728981888:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784404924.739111:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784404925.111315:0:19473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784404925.111318:0:19473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784404925.111320:0:19473:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784404925.111426:0:19473:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd4435d4800 00000020:01000004:1.0:1784404925.111443:0:19473:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1784404925.111458:0:19473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784404925.111472:0:19473:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dd4421399c0) 00000020:00000080:1.0:1784404925.111492:0:19473:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000040:00080000:2.0:1784404925.128303:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:0.0:1784404925.215492:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784404925.216630:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784404925.217218:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1784404925.217416:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784404925.217926:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1784404925.218185:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784404925.218441:0:19473:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1784404925.221793:0:19473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784404925.222071:0:19473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1784404925.222109:0:19473:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784404925.222125:0:19473:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b3e2e6dcd7a218 00000020:01000004:0.0:1784404925.222134:0:19473:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784404925.222158:0:19473:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784404925.222162:0:19473:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784404925.222176:0:19473:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1784404925.222205:0:19473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1784404925.222209:0:19473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784404925.246674:0:19473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784404925.246733:0:19473:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1784404925.246739:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784404925.246741:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784404925.246742:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404925.246744:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404925.246745:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404925.246746:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404925.246748:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404925.246749:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404925.246751:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784404925.246755:0:19473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1784404925.246757:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784404925.246758:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784404925.246759:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404925.246760:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404925.246761:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404925.246762:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404925.246763:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404925.246765:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404925.246766:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784404925.246794:0:19473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784404925.246816:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784404925.246931:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.246971:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54540 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.247059:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982016 00000100:00100000:0.0:1784404925.247068:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982016 00000100:00100000:0.0:1784404925.247126:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784404925.247136:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:19473:x1871083728982016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784404925.247168:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784404925.247172:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1784404925.247177:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784404925.248200:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:19473:x1871083728982016:12345-0@lo:253:mount.lustre.0 Request processed in 1061us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404925.248212:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784404925.248307:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982016:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784404925.248319:0:19473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784404925.248322:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784404925.248323:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784404925.248325:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784404925.248326:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784404925.248327:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784404925.248329:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784404925.248330:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784404925.248332:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784404925.248333:0:19473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784404925.248354:0:19473:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd4435d4800 from lustre-OST0001 10000000:01000000:3.0:1784404925.248398:0:19473:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784404925.248412:0:19473:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784404925.248420:0:19473:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd573b199c0 local copy 00010000:00010000:3.0:1784404925.248430:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404925.248514:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404925.248547:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.248615:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd541671cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404925.250218:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982144 00000100:00100000:1.0:1784404925.250232:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982144 00000100:00100000:1.0:1784404925.250331:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784404925.250343:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:19473:x1871083728982144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404925.250478:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:19473:x1871083728982144:12345-0@lo:501:mount.lustre.0 Request processed in 137us (1929us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784404925.250486:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784404925.250567:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982144:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784404925.250587:0:19473:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784404925.250611:0:19473:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784404925.250620:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.250631:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404925.250663:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd4435d4800 10000000:01000000:3.0:1784404925.250669:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784404925.250685:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784404925.250689:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784404925.250694:0:19473:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784404925.250697:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784404925.250730:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.250739:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.250768:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404925.250787:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784404925.250821:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.251698:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd541671cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.251890:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982272 00000100:00100000:0.0:1784404925.251898:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982272 00000100:00100000:0.0:1784404925.251941:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784404925.251949:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:19473:x1871083728982272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404925.251961:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404925.251976:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd7a226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a21f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.252000:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd7a226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a21f expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.252010:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd7a226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a21f expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.252019:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a200, rc 0) 00000100:00100000:0.0:1784404925.252319:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982272:12345-0@lo:101:mount.lustre.0 Request processed in 370us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.252326:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784404925.252552:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784404925.252569:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.252579:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784404925.253668:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784404925.255429:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784404925.258665:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784404925.258744:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784404925.258762:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784404925.258796:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784404925.258811:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784404925.258825:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784404925.259016:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784404925.259025:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784404925.259230:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404925.259303:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.259399:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5452359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.259505:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982400 00000100:00100000:0.0:1784404925.259521:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982400 00000100:00100000:0.0:1784404925.259618:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784404925.259628:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404925.259815:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982400:12345-0@lo:501:mount.lustre.0 Request processed in 188us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.259823:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784404925.259917:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404925.259960:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404925.260001:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.260350:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5452359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404925.260453:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982528 00000100:00100000:2.0:1784404925.260459:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982528 00000100:00100000:2.0:1784404925.260490:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784404925.260498:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404925.261324:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982528:12345-0@lo:503:mount.lustre.0 Request processed in 824us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404925.261334:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784404925.261443:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784404925.261969:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784404925.262134:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784404925.262191:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.262216:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5452359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404925.263158:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982656 00000100:00100000:2.0:1784404925.263168:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982656 00000100:00100000:2.0:1784404925.263215:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784404925.263224:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784404925.264144:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982656:12345-0@lo:502:mount.lustre.0 Request processed in 917us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404925.264156:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784404925.264378:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784404925.264593:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784404925.264625:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784404925.264637:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784404925.264647:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784404925.264658:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784404925.264669:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784404925.264691:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784404925.264705:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784404925.264715:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1784404925.264753:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784404925.264799:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.264826:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5452359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.264909:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982784 00000100:00100000:0.0:1784404925.264916:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982784 00000100:00100000:0.0:1784404925.264946:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784404925.264954:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.265113:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982784:12345-0@lo:502:mount.lustre.0 Request processed in 158us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.265120:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784404925.265317:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784404925.265357:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1784404925.265418:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1784404925.266495:0:19477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784404925.266506:0:19477:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1784404925.266513:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784404925.266515:0:19477:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784404925.266521:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784404925.266536:0:19477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dd573a8b380) 00000020:00000080:0.0:1784404925.266561:0:19477:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784404925.266567:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784404925.266667:0:19477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd4435d4800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784404925.266675:0:19477:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784404925.266694:0:19477:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b3e2e6dcd7a234 00010000:00010000:1.0:1784404925.272969:0:19477:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1784404925.273741:0:19477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1784404925.275514:0:19477:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1784404925.279166:0:19477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784404925.279181:0:19477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404925.279202:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404925.279204:0:19477:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784404925.279209:0:19477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404925.279213:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404925.279215:0:19477:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784404925.279219:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784404925.279221:0:19477:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784404925.279223:0:19477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404925.279226:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404925.279227:0:19477:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784404925.279230:0:19477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784404925.279232:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404925.279233:0:19477:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784404925.279236:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784404925.279268:0:19477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784404925.279272:0:19477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784404925.279273:0:19477:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784404925.279276:0:19477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1784404925.279606:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1784404925.279635:0:19473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784404925.279658:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404925.279671:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404925.279688:0:19473:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd4435d4800 from 1 10000000:01000000:1.0:1784404925.279692:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404925.279733:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404925.279755:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404925.279767:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404925.279797:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784404925.279890:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.279933:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4434780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404925.280053:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728982912 00000100:00100000:2.0:1784404925.280062:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728982912 00000100:00100000:2.0:1784404925.280116:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784404925.280125:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:19473:x1871083728982912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784404925.280140:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404925.280155:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a23b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404925.280184:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404925.280194:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404925.280217:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e200, rc 0) 00000100:00100000:2.0:1784404925.280262:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728982912:12345-0@lo:101:mount.lustre.0 Request processed in 138us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404925.280268:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784404925.280493:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728982912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784404925.280509:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404925.280519:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404925.283165:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784404925.283539:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404925.283731:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784404925.283757:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784404925.283775:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784404925.283781:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784404925.285173:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404925.285263:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.285313:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404925.285466:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983040 00000100:00100000:3.0:1784404925.285474:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983040 00000100:00100000:3.0:1784404925.285533:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784404925.285543:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784404925.285691:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983040:12345-0@lo:501:mount.lustre.0 Request processed in 149us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.285698:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784404925.286845:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404925.286919:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784404925.286982:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.287012:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784404925.287199:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983168 00000100:00100000:3.0:1784404925.287205:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983168 00000100:00100000:3.0:1784404925.287252:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784404925.287261:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784404925.287383:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983168:12345-0@lo:503:mount.lustre.0 Request processed in 123us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.287398:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784404925.288527:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983168:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784404925.288986:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784404925.289143:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.289202:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.289253:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404925.289458:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983296 00000100:00100000:1.0:1784404925.289464:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983296 00000100:00100000:1.0:1784404925.289505:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784404925.289514:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404925.289614:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983296:12345-0@lo:502:mount.lustre.0 Request processed in 100us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404925.289621:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784404925.290168:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784404925.290542:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784404925.290575:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1784404925.290592:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1784404925.290606:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1784404925.290619:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1784404925.290631:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1784404925.290641:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1784404925.290652:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1784404925.290662:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784404925.290672:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1784404925.290697:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1784404925.290728:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.290776:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.290806:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784404925.290896:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983424 00000100:00100000:1.0:1784404925.290901:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983424 00000100:00100000:1.0:1784404925.290936:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784404925.290945:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784404925.291030:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983424:12345-0@lo:502:mount.lustre.0 Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404925.291036:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784404925.291569:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784404925.291634:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1784404925.291645:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1784404925.294330:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404925.294343:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294346:0:19481:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784404925.294352:0:19481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd4435d4800 00000020:00000080:1.0:1784404925.294356:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784404925.294373:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404925.294377:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294378:0:19481:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784404925.294381:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404925.294383:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294385:0:19481:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784404925.294388:0:19481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd4435d4800 00000020:00000080:1.0:1784404925.294390:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784404925.294459:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404925.294462:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294464:0:19481:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784404925.294466:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404925.294468:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294470:0:19481:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784404925.294472:0:19481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd4435d4800 00000020:00000080:1.0:1784404925.294475:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784404925.294492:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404925.294495:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294497:0:19481:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784404925.294499:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784404925.294502:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294503:0:19481:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784404925.294506:0:19481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd4435d4800 00000020:00000080:1.0:1784404925.294508:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784404925.294531:0:19481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784404925.294534:0:19481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784404925.294536:0:19481:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784404925.294539:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1784404925.298967:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1784404925.299013:0:19473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784404925.299037:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.299049:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404925.299113:0:19473:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784404925.299116:0:19473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd4435d4800 10000000:01000000:0.0:1784404925.299124:0:19473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd4435d4800 10000000:01000000:0.0:1784404925.299127:0:19473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784404925.299133:0:19473:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd4435d4800 from 1 10000000:01000000:0.0:1784404925.299135:0:19473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784404925.299171:0:19473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.299180:0:19473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.299192:0:19473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404925.299217:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784404925.299284:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.299326:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983552 00000100:00100000:0.0:1784404925.299332:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983552 00000100:00100000:0.0:1784404925.299378:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784404925.299387:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:19473:x1871083728983552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404925.299400:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404925.299413:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd7a250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a249 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.299435:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd7a250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a249 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.299446:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd7a250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a249 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.299453:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a800, rc 0) 00000100:00100000:0.0:1784404925.299493:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728983552:12345-0@lo:101:mount.lustre.0 Request processed in 107us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.299500:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784404925.299544:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.299565:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784404925.299580:0:19473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404925.299589:0:19473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404925.312532:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1784404925.312939:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784404925.314271:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784404925.314319:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784404925.314333:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784404925.314346:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784404925.314361:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784404925.314449:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784404925.314485:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784404925.314500:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784404925.314514:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784404925.314528:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784404925.314541:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784404925.314564:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784404925.314577:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784404925.314591:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784404925.314603:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784404925.314615:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784404925.314628:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784404925.314640:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784404925.314652:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784404925.314664:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784404925.314688:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784404925.314702:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784404925.314727:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784404925.314741:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784404925.314752:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1784404925.314764:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1784404925.314776:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1784404925.314787:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1784404925.314800:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1784404925.314812:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1784404925.314825:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1784404925.314839:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1784404925.314875:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1784404925.314892:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1784404925.314905:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1784404925.314918:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1784404925.314932:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1784404925.314945:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1784404925.314970:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1784404925.314984:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1784404925.314995:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1784404925.315005:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1784404925.315015:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1784404925.315025:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1784404925.317496:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1784404925.317547:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1784404925.317577:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1784404925.317584:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1784404925.317700:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784404925.317776:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.317830:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.319186:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983680 00000100:00100000:0.0:1784404925.319198:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983680 00000100:00100000:0.0:1784404925.319262:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784404925.319272:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728983680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784404925.325336:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728983680:12345-0@lo:501:mount.lustre.0 Request processed in 6056us (7551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.325352:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784404925.325532:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784404925.325595:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784404925.325659:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404925.325707:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.328569:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983808 00000100:00100000:0.0:1784404925.328585:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983808 00000100:00100000:0.0:1784404925.328663:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784404925.328674:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728983808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784404925.328886:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728983808:12345-0@lo:503:mount.lustre.0 Request processed in 214us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.328893:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784404925.328965:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784404925.329501:0:19473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784404925.329715:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.329774:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.329817:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728983936 00000100:00100000:0.0:1784404925.329824:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728983936 00000100:00100000:0.0:1784404925.329880:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784404925.329888:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728983936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.329986:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728983936:12345-0@lo:502:mount.lustre.0 Request processed in 98us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.329994:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784404925.330034:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.330052:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728983936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784404925.330225:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784404925.330252:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1784404925.330266:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1784404925.330277:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1784404925.330289:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1784404925.330301:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1784404925.330313:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1784404925.330327:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1784404925.330341:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784404925.330356:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1784404925.330384:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1784404925.330398:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1784404925.330409:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1784404925.330423:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1784404925.330436:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1784404925.330450:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1784404925.330464:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1784404925.330477:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1784404925.330501:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1784404925.330515:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1784404925.330527:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1784404925.330540:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1784404925.330552:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1784404925.330565:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1784404925.330578:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1784404925.330589:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1784404925.330609:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1784404925.330622:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1784404925.330632:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1784404925.330646:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1784404925.330659:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1784404925.330670:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1784404925.330696:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1784404925.330712:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1784404925.330724:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1784404925.330736:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1784404925.330747:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1784404925.330761:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1784404925.330773:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1784404925.330786:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1784404925.330798:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1784404925.330809:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1784404925.330835:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1784404925.330879:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1784404925.330895:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1784404925.330908:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1784404925.330920:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1784404925.330932:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1784404925.330972:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728984064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.331022:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.331060:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984064 00000100:00100000:0.0:1784404925.331065:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984064 00000100:00100000:0.0:1784404925.331092:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784404925.331098:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728984064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.331179:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728984064:12345-0@lo:502:mount.lustre.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.331186:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784404925.331222:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.331238:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728984064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784404925.331371:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1784404925.331391:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1784404925.331410:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728984192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.331440:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.331460:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984192 00000100:00100000:0.0:1784404925.331464:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984192 00000100:00100000:0.0:1784404925.331486:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784404925.331492:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728984192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784404925.331547:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728984192:12345-0@lo:502:mount.lustre.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.331554:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784404925.331581:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.331593:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728984192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784404925.331624:0:19473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1784404925.331631:0:19473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1784404925.350127:0:19486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784404925.350148:0:19486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dd5445f99c0) 00000020:00000080:2.0:1784404925.350174:0:19486:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1784404925.350937:0:19486:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd4435d4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784404925.350943:0:19486:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd4435d4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784404925.350946:0:19486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd4435d4800 3 00010000:00080000:2.0:1784404925.350981:0:19486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd4433f8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784404925.356599:0:19486:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1784404925.357256:0:19486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784404925.357581:0:19486:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784404925.357598:0:19486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x24b3e2e6dcd7a25e 00000100:00080000:2.0:1784404925.357610:0:19486:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404925.357616:0:19486:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd4433f8000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404925.357654:0:19486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ff8700 x1871083728984320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404925.357698:0:19486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784404925.357806:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728984320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784404925.357901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.357959:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984320 00000100:00100000:3.0:1784404925.357966:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984320 00000100:00100000:3.0:1784404925.357996:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404925.358002:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083728984320:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784404925.358025:0:17153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1784404925.358119:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x24b3e2e6dcd7a265 00000004:00100000:3.0:1784404925.358134:0:17153:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784404925.358164:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9dd573222800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784404925.358218:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1871083728984320:12345-0@lo:38:llog_process_th.0 Request processed in 214us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.358226:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784404925.358264:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ff8700 x1871083728984320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404925.358275:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784404925.358282:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1784404925.358288:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784404925.358292:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784404925.358295:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784404925.358301:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083728984320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784404925.358487:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728984448:0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.358524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.359929:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984448 00000100:00100000:3.0:1784404925.359939:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984448 00000100:00100000:3.0:1784404925.359988:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784404925.360004:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728984448:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784404925.363033:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404925.363067:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784404925.363071:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404925.363081:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1784404925.363086:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784404925.363094:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd441a60000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404925.363133:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ff8700 x1871083728984704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404925.363184:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784404925.363187:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784404925.363189:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404925.363193:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1784404925.363195:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784404925.363199:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd548765000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404925.363210:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd541664000 x1871083728985216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404925.363464:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728984576:0@lo:400:kworker.0 00000100:00100000:1.0:1784404925.363535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.363567:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728985344:0@lo:400:kworker.0 00000100:00100000:1.0:1784404925.363590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.363613:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784404925.363619:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728984832:0@lo:400:kworker.0 00000100:00100000:1.0:1784404925.363640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.363657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728985472:0@lo:400:kworker.0 00000100:00100000:3.0:1784404925.363789:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728984448:12345-0@lo:400:kworker.0 Request processed in 3785us (5262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.363800:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784404925.363838:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728984704:0@lo:8:kworker.0 00000100:00100000:3.0:1784404925.363881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.363898:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728985216:0@lo:8:kworker.0 00000100:00100000:3.0:1784404925.363921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.363950:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984576 00000100:00100000:3.0:1784404925.363957:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984576 00000100:00100000:3.0:1784404925.363997:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984704 00000100:00100000:3.0:1784404925.364000:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984704 00000100:00100000:3.0:1784404925.364009:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985216 00000100:00100000:3.0:1784404925.364011:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985216 00000100:00100000:3.0:1784404925.364022:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404925.364029:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728984576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404925.364083:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728984576:12345-0@lo:400:kworker.0 Request processed in 54us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.364088:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784404925.364099:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784404925.364103:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1871083728984704:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784404925.364139:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1871083728984704:12345-0@lo:8:kworker.0 Request processed in 35us (258us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784404925.364145:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784404925.364154:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404925.364158:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1871083728985216:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784404925.364182:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1871083728985216:12345-0@lo:8:kworker.0 Request processed in 23us (261us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784404925.364195:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1784404925.364209:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404925.364232:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784404925.364238:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404925.364243:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784404925.364245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728984704:0@lo:8:kworker.0 00000100:00100000:3.0:1784404925.364252:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784404925.364254:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404925.364257:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784404925.364259:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728985216:0@lo:8:kworker.0 00000100:00100000:1.0:1784404925.364537:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.364570:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728984576:0@lo:400:kworker.0 00000100:00100000:1.0:1784404925.364665:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985344 00000100:00100000:1.0:1784404925.364669:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985344 00000100:00100000:1.0:1784404925.364706:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984832 00000100:00100000:1.0:1784404925.364709:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984832 00000100:00100000:1.0:1784404925.364719:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985472 00000100:00100000:1.0:1784404925.364721:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985472 00000100:00100000:1.0:1784404925.364738:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404925.364744:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728985344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404925.364782:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728985344:12345-0@lo:400:kworker.0 Request processed in 38us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404925.364798:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404925.364812:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784404925.364817:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728984832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404925.364844:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728984832:12345-0@lo:400:kworker.0 Request processed in 28us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404925.364871:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784404925.364884:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784404925.364889:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728985472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404925.364916:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728985472:12345-0@lo:400:kworker.0 Request processed in 27us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404925.364921:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1784404925.364958:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784404925.364975:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd577ffad80 x1871083728984832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404925.364986:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728984832:0@lo:400:kworker.0 00010000:00080000:1.0:1784404925.364996:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd541664380 x1871083728985472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404925.365003:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728985472:0@lo:400:kworker.0 00010000:00080000:1.0:1784404925.365012:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd541664700 x1871083728985344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404925.365018:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728985344:0@lo:400:kworker.0 00000020:01000004:2.0:1784404925.366243:0:19486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784404925.366288:0:19486:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dd4430a19c0) 00000020:00000080:2.0:1784404925.366311:0:19486:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784404925.366563:0:19486:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd4435d4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784404925.366567:0:19486:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd4435d4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784404925.366569:0:19486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd4435d4800 3 00010000:00080000:2.0:1784404925.366596:0:19486:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd4433f8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.142@tcp at head 00000100:00100000:0.0:1784404925.368971:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728984448:0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.369031:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728984960:0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.369112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.369144:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728985600:0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.369168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.369203:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728984960 00000100:00100000:0.0:1784404925.369209:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728984960 00000100:00100000:0.0:1784404925.369250:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784404925.369259:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728984960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.369312:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728984960:12345-0@lo:400:kworker.0 Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.369319:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784404925.369340:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985600 00000100:00100000:0.0:1784404925.369343:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985600 00000100:00100000:0.0:1784404925.369389:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404925.369396:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728985600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.369427:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083728985600:12345-0@lo:400:kworker.0 Request processed in 32us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.369432:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404925.369460:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728984960:0@lo:400:kworker.0 00010000:00080000:0.0:1784404925.369471:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd541666a00 x1871083728985600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404925.369481:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083728985600:0@lo:400:kworker.0 00000100:00080000:0.0:1784404925.369498:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404925.369511:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728985088:0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.369549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.369573:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985088 00000100:00100000:0.0:1784404925.369577:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985088 00000100:00100000:0.0:1784404925.369607:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784404925.369613:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728985088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404925.369641:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728985088:12345-0@lo:400:kworker.0 Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.369647:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1784404925.369660:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404925.369690:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728985088:0@lo:400:kworker.0 00010000:00010000:2.0:1784404925.372095:0:19486:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1784404925.372206:0:19486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1784404925.372250:0:19486:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784404925.372262:0:19486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x24b3e2e6dcd7a273 00000100:00080000:2.0:1784404925.372271:0:19486:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784404925.372284:0:19486:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd4433f8800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404925.372319:0:19486:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd541665c00 x1871083728985728/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784404925.372351:0:19486:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784404925.373483:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083728985728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784404925.373556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404925.373616:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985728 00000100:00100000:0.0:1784404925.373622:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985728 00000100:00100000:0.0:1784404925.373652:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784404925.373658:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1871083728985728:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784404925.373695:0:18438:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1784404925.373729:0:18438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x24b3e2e6dcd7a27a 00000004:00100000:0.0:1784404925.373742:0:18438:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784404925.373773:0:18438:0:(import.c:65:import_set_state_nolock()) ffff9dd441a2d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404925.373819:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1871083728985728:12345-0@lo:38:llog_process_th.0 Request processed in 160us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404925.373826:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784404925.373879:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd541665c00 x1871083728985728/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784404935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404925.373889:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784404925.373908:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784404925.373916:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784404925.373920:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784404925.373922:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784404925.373927:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083728985728:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1784404925.374723:0:19486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1784404925.374997:0:19473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784404925.375032:0:19473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784404925.378307:0:19473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404925.378321:0:19473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784404925.378411:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784404925.378414:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784404925.378416:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404925.378417:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404925.378418:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404925.378420:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404925.378421:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404925.378423:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404925.378424:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404925.378428:0:19473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1784404925.378431:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784404925.378432:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784404925.378433:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404925.378434:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404925.378435:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404925.378436:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404925.378437:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404925.378438:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404925.378438:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784404925.378467:0:19473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784404925.378491:0:19473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728985856:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784404925.378561:0:19473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404925.378604:0:19473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443478d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404925.378781:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985856 00000100:00100000:0.0:1784404925.378788:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985856 00000100:00100000:0.0:1784404925.378843:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784404925.378878:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728985856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784404925.378904:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784404925.378919:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784404925.394052:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784404925.394070:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784404925.394500:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:19473:x1871083728985856:12345-0@lo:253:mount.lustre.0 Request processed in 15642us (15932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404925.394514:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:3.0:1784404925.394633:0:17169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784404925.394638:0:17169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784404925.394662:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.394690:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.394699:0:17169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.394707:0:17169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.394748:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.394762:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 23 pid: 17146 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404925.394788:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728985984:0@lo:104: 00000100:00100000:3.0:1784404925.394822:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784404925.394890:0:17169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.394899:0:17169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 23 pid: 17149 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404925.394907:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728986112:0@lo:104: 00000100:00100000:3.0:1784404925.394926:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.394941:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44328c300 going to sleep for 11 seconds 00000100:00100000:3.0:1784404925.394959:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728985984 00000100:00100000:3.0:1784404925.394965:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728985984 00000100:00100000:3.0:1784404925.394996:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728986112 00000100:00100000:3.0:1784404925.394998:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728986112 00000100:00100000:3.0:1784404925.395010:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404925.395017:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:17169:x1871083728985984:12345-0@lo:104: 00010000:00010000:3.0:1784404925.395028:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395078:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784404925.395083:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:17169:x1871083728985984:12345-0@lo:104: Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.395089:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404925.395102:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404925.395107:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728986112:12345-0@lo:104: 00010000:00010000:3.0:1784404925.395113:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395150:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784404925.395155:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:17169:x1871083728986112:12345-0@lo:104: Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.395161:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1784404925.395178:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784404925.395183:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395190:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404925.395194:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395201:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404925.395208:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404925.395214:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404925.395240:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395245:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404925.395267:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395445:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a138 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395470:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404925.395473:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395478:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404925.395481:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395488:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404925.395494:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404925.395500:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784404925.395513:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395519:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404925.395535:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395542:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd548759e00/0x24b3e2e6dcd7a123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a12a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395554:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404925.395555:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404925.395557:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404925.395563:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404925.395582:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404925.395593:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728986240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404925.395620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.395645:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728986368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404925.395666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404925.395708:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728986240 00000100:00100000:3.0:1784404925.395712:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728986240 00010000:00010000:3.0:1784404925.395729:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 24 pid: 17146 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404925.395750:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728986368 00000100:00100000:3.0:1784404925.395752:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728986368 00010000:00010000:3.0:1784404925.395762:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 25 pid: 17149 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404925.395774:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404925.395779:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+25:3646:x1871083728986240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404925.395789:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404925.395793:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 25 pid: 17146 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395802:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 25 pid: 17146 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395816:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404925.395841:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+25:3646:x1871083728986240:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404925.395848:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404925.395883:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404925.395889:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083728986368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404925.395902:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404925.395907:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 24 pid: 17149 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395915:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 24 pid: 17149 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395926:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395933:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784404925.395946:0:17140:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002712274s 00010000:00010000:3.0:1784404925.395950:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395956:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395963:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395969:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395974:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404925.395977:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395983:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.395998:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404925.396007:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404925.396033:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083728986368:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404925.396231:0:19473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:19473:1871083728985856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784404925.396243:0:19473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784404925.396246:0:19473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784404925.396248:0:19473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784404925.396249:0:19473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784404925.396256:0:19473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784404925.396257:0:19473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784404925.396259:0:19473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784404925.396260:0:19473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784404925.396261:0:19473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784404925.396263:0:19473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784404925.396291:0:19473:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784404925.401926:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404925.402017:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728986368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404925.402067:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728986240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784404925.402265:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd548759a00/0x24b3e2e6dcd7a138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a131 expref: 23 pid: 17146 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404925.402294:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728985984:0@lo:104: 00010000:00010000:2.0:1784404925.402305:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a000/0x24b3e2e6dcd7a12a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a123 expref: 22 pid: 17149 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404925.402314:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17169:1871083728986112:0@lo:104: 00010000:00010000:2.0:1784404925.402332:0:17169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404925.402343:0:17169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404925.402350:0:17169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404925.402356:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c6800/0x24b3e2e6dcd7a281 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1784404925.441573:0:19473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784404925.454377:0:19473:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784404925.454391:0:19473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784404925.454451:0:19473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784404925.454508:0:19473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784404925.454530:0:19473:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1784404925.454563:0:19473:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1784404925.459758:0:19473:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404925.472689:0:19473:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784404925.763001:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784404926.535763:0:19540:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784404926.536091:0:19540:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784404926.792988:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784404927.427030:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784404927.427050:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442285000 from 10 10000000:01000000:3.0:1784404927.427057:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784404927.427113:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404927.427128:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404927.427140:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404927.427174:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404927.427257:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404927.427320:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57b4c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404927.427470:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728986496 00000100:00100000:1.0:1784404927.427480:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728986496 00000100:00100000:1.0:1784404927.427544:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784404927.427554:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:17151:x1871083728986496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404927.427577:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404927.427592:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031a00/0x24b3e2e6dcd7a28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a288 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.427616:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031a00/0x24b3e2e6dcd7a28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a288 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.427626:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031a00/0x24b3e2e6dcd7a28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a288 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.427635:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031a00, rc 0) 00000100:00100000:1.0:1784404927.427695:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728986496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404927.427702:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784404927.427789:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404927.427820:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404927.427829:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404927.427905:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784404927.427938:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404927.427964:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57b4c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404927.428017:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728986624 00000100:00100000:0.0:1784404927.428022:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728986624 00000100:00100000:0.0:1784404927.428063:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784404927.428071:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728986624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784404927.428084:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784404927.428102:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784404927.428106:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1784404927.428188:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728986624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404927.428201:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784404927.428517:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784404927.428591:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784404927.428599:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404927.428608:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404927.428618:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784404927.428621:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd443e83000 from 10 10000000:01000000:3.0:1784404927.428623:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784404927.428647:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404927.428654:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404927.428673:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404927.428697:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404927.428726:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404927.428755:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57b4c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404927.428800:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728986752 00000100:00100000:1.0:1784404927.428804:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728986752 00000100:00100000:1.0:1784404927.428838:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784404927.428845:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728986752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404927.428879:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404927.428892:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540030000/0x24b3e2e6dcd7a29d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a296 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.428908:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540030000/0x24b3e2e6dcd7a29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a296 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.428916:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540030000/0x24b3e2e6dcd7a29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a296 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.428922:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540030000, rc 0) 00000100:00100000:1.0:1784404927.428951:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728986752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404927.428957:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784404927.428983:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404927.428992:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.428998:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404927.429032:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784404927.429070:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404927.429089:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c5809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404927.429101:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728986880 00000100:00100000:1.0:1784404927.429104:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728986880 00000100:00100000:1.0:1784404927.429125:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784404927.429131:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728986880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784404927.429151:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784404927.429163:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784404927.429166:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1784404927.429239:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728986880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404927.429246:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784404927.429275:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728986880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784404927.429316:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784404927.429321:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404927.429329:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404927.811017:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404928.387139:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728987008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404928.387238:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404928.387696:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987008 00000100:00100000:2.0:1784404928.387705:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987008 00000100:00100000:2.0:1784404928.387782:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784404928.387792:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728987008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404928.387824:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1784404928.388760:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404928.389165:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728987136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784404928.389236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404928.389594:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1784404928.389603:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1784404928.389929:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987136 00000100:00100000:1.0:1784404928.389936:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987136 00000100:00080000:1.0:1784404928.389982:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404928.390110:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784404928.390121:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728987136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404928.390146:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784404928.390511:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728987136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 391us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404928.390531:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404928.390631:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728987136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404928.391770:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728987008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3973us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404928.391781:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784404928.392532:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728987008:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784404928.836111:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404929.415658:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404929.415686:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728987264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404929.415769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404929.415819:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987264 00000100:00100000:2.0:1784404929.415828:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987264 00000100:00100000:2.0:1784404929.415896:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404929.415905:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728987264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784404929.415941:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784404929.416000:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728987264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404929.416008:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404929.416058:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728987264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404929.418220:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728987392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404929.418358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404929.418422:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987392 00000100:00100000:2.0:1784404929.418429:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987392 00000100:00100000:2.0:1784404929.418471:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404929.418487:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728987392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784404929.418519:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784404929.418566:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728987392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404929.418574:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404929.418624:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728987392:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784404929.859023:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404930.436173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404930.436181:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784404930.436185:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404930.436199:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd441a60000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404930.436224:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd57c929500 x1871083728987904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784404930.436273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784404930.436277:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784404930.436279:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404930.436284:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd548765000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404930.436297:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd57c92aa00 x1871083728988416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404930.436346:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728987776:0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.436420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436456:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728988544:0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.436482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436500:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728989056:0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.436522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436547:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784404930.436553:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728987648:0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.436592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436620:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728988288:0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.436655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436674:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728988928:0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.436713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436743:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728987904:0@lo:8:kworker.0 00000100:00100000:1.0:1784404930.436768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436786:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728988416:0@lo:8:kworker.0 00000100:00100000:1.0:1784404930.436805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.436847:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987776 00000100:00100000:1.0:1784404930.436880:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987776 00000100:00100000:1.0:1784404930.436931:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988288 00000100:00100000:1.0:1784404930.436934:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988288 00000100:00100000:1.0:1784404930.436949:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987904 00000100:00100000:1.0:1784404930.436953:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987904 00000100:00100000:1.0:1784404930.436960:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988416 00000100:00100000:1.0:1784404930.436963:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988416 00000100:00100000:1.0:1784404930.436974:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404930.436983:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.437038:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728987776:12345-0@lo:400:kworker.0 Request processed in 55us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.437045:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784404930.437062:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404930.437068:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.437095:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728988288:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.437100:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784404930.437112:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404930.437116:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728987904:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784404930.437143:0:18660:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1784404930.437174:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a2a4 00002000:00100000:1.0:1784404930.437190:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dd442085000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784404930.437194:0:18660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784404930.437197:0:18660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784404930.437379:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784404930.437403:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9dd442086800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404930.437443:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083728987904:12345-0@lo:8:kworker.0 Request processed in 325us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.437457:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404930.437470:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404930.437474:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083728988416:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784404930.437488:0:18660:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1784404930.437503:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a2ab 00002000:00100000:1.0:1784404930.437510:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dd442083000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1784404930.437513:0:18660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1784404930.437515:0:18660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784404930.437539:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1784404930.437553:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9dd442085800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404930.437582:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083728988416:12345-0@lo:8:kworker.0 Request processed in 107us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.437587:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404930.437609:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988544 00000100:00100000:1.0:1784404930.437613:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988544 00000100:00100000:1.0:1784404930.437650:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989056 00000100:00100000:1.0:1784404930.437653:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989056 00000100:00100000:1.0:1784404930.437669:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988928 00000100:00100000:1.0:1784404930.437672:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988928 00000100:00100000:1.0:1784404930.437686:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404930.437692:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728988544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.437726:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728988544:12345-0@lo:400:kworker.0 Request processed in 34us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.437732:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784404930.437744:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404930.437750:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728989056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.437803:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728989056:12345-0@lo:400:kworker.0 Request processed in 52us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.437809:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784404930.437821:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784404930.437827:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728988928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.437875:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728988928:12345-0@lo:400:kworker.0 Request processed in 25us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.437881:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1784404930.437917:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404930.437921:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404930.437923:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784404930.437950:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929500 x1871083728987904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404930.437964:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784404930.437972:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784404930.437977:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784404930.437979:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784404930.438001:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784404930.438007:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083728987904:0@lo:8:kworker.0 00010000:00080000:1.0:1784404930.438019:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92aa00 x1871083728988416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784404955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404930.438026:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1784404930.438030:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784404930.438033:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784404930.438035:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784404930.438045:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784404930.438056:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083728988416:0@lo:8:kworker.0 00000100:00100000:1.0:1784404930.438091:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728988288:0@lo:400:kworker.0 00010000:00080000:1.0:1784404930.438102:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92b480 x1871083728988928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404930.438110:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728988928:0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.438120:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728987776:0@lo:400:kworker.0 00010000:00080000:1.0:1784404930.438130:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929c00 x1871083728988544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404930.438138:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728988544:0@lo:400:kworker.0 00010000:00080000:1.0:1784404930.438148:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443cde300 x1871083728989056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404930.438156:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728989056:0@lo:400:kworker.0 00000004:00080000:1.0:1784404930.438218:0:17897:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1784404930.438237:0:17897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17897:1871083728989312:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1784404930.438264:0:17897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.438282:0:17897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c5803c0 going to sleep for 11 seconds 00000004:00080000:1.0:1784404930.438304:0:17180:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1784404930.438316:0:17180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1871083728989568:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784404930.438339:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.438353:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c580840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404930.438365:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989312 00000100:00100000:1.0:1784404930.438369:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989312 00000100:00100000:1.0:1784404930.438393:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989568 00000100:00100000:1.0:1784404930.438402:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989568 00000100:00100000:1.0:1784404930.438425:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404930.438431:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17897:x1871083728989312:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1784404930.438669:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784404930.438677:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1871083728989568:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1784404930.438714:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1784404930.438737:0:17896:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784404930.438807:0:17896:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 548322954650ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784404930.438814:0:17896:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784404930.439625:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728987520:0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.439696:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404930.439736:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728988160:0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.439761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404930.439781:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728988800:0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.439807:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404930.439826:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404930.439848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404930.439894:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784404930.439901:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728988032:0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.439923:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404930.439939:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728988672:0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.439958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404930.439975:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728989184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404930.439994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404930.440030:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987648 00000100:00100000:2.0:1784404930.440036:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987648 00000100:00100000:2.0:1784404930.440072:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988160 00000100:00100000:2.0:1784404930.440075:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988160 00000100:00100000:2.0:1784404930.440105:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784404930.440112:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728987648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.440165:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728987648:12345-0@lo:400:kworker.0 Request processed in 53us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.440172:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784404930.440191:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784404930.440197:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.440228:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728988160:12345-0@lo:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.440234:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784404930.440253:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988800 00000100:00100000:2.0:1784404930.440256:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988800 00000100:00100000:2.0:1784404930.440283:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988032 00000100:00100000:2.0:1784404930.440286:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988032 00000100:00100000:2.0:1784404930.440295:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728988672 00000100:00100000:2.0:1784404930.440297:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728988672 00000100:00100000:2.0:1784404930.440310:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784404930.440315:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.440345:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728988800:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.440351:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784404930.440363:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784404930.440368:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.440397:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083728988032:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.440402:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784404930.440413:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784404930.440425:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728988672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404930.440452:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083728988672:12345-0@lo:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.440457:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1784404930.440476:0:17179:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784404930.440548:0:17179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 548324696163ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784404930.440553:0:17179:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784404930.440715:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989440 00000100:00100000:2.0:1784404930.440720:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989440 00000100:00100000:2.0:1784404930.440745:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989184 00000100:00100000:2.0:1784404930.440749:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989184 00000100:00100000:2.0:1784404930.440761:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784404930.440766:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083728989440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404930.440786:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784404930.440821:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083728989440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.440827:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784404930.440839:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784404930.440844:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1871083728989184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404930.440875:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784404930.440938:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1871083728989184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.440944:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1784404930.441091:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404930.441096:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784404930.441210:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c928000 x1871083728988032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404930.441238:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083728988032:0@lo:400:kworker.0 00010000:00080000:2.0:1784404930.441253:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92b800 x1871083728988672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404930.441262:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083728988672:0@lo:400:kworker.0 00010000:00080000:2.0:1784404930.441271:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348f480 x1871083728989184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404930.441283:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728989184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404930.441294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728988160:0@lo:400:kworker.0 00010000:00080000:2.0:1784404930.441304:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083728988800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404930.441311:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728988800:0@lo:400:kworker.0 00010000:00080000:2.0:1784404930.441320:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348ca80 x1871083728989440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784404946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404930.441330:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404930.441373:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728987648:0@lo:400:kworker.0 00000004:00080000:0.0:1784404930.448690:0:17134:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784404930.451625:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728987520 00000100:00100000:1.0:1784404930.451648:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728987520 00000100:00100000:1.0:1784404930.451828:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784404930.451839:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3649:x1871083728987520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404930.451963:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3649:x1871083728987520:12345-0@lo:400:kworker.0 Request processed in 126us (12267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.451972:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784404930.457152:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728987520:0@lo:400:kworker.0 00002000:00080000:2.0:1784404930.462549:0:19139:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1784404930.462574:0:19139:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000004:00080000:0.0:1784404930.462653:0:17886:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1784404930.462708:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17897:x1871083728989312:12345-0@lo:7:osp-pre-1-1.0 Request processed in 24270us (24436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404930.462720:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00080000:0.0:1784404930.462845:0:18661:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1784404930.462864:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00010000:00080000:1.0:1784404930.462866:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348ea00 x1871083728989312/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784404946 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00002000:02000040:0.0:1784404930.462870:0:18661:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:1.0:1784404930.462882:0:17897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17897:1871083728989312:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1784404930.462895:0:17897:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784404930.462940:0:17897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17897:1871083728989696:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1784404930.462975:0:17897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.463007:0:17897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c5803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784404930.463409:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989696 00000100:00100000:2.0:1784404930.463417:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989696 00000100:00100000:2.0:1784404930.463472:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784404930.463483:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17897:x1871083728989696:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1784404930.463508:0:18662:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1784404930.463548:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17897:x1871083728989696:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67us (572us total) trans 0 rc 0/0 00010000:00080000:1.0:1784404930.463699:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348ea00 x1871083728989696/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784404946 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404930.464166:0:17897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17897:1871083728989696:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1784404930.464188:0:17897:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784404930.464223:0:17897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17897:1871083728989824:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1784404930.464254:0:17897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.464279:0:17897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c5803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404930.468968:0:19139:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1784404930.468991:0:19139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1784404930.469112:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989824 00000100:00100000:3.0:1784404930.469122:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989824 00000100:00100000:3.0:1784404930.469253:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784404930.469265:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:17897:x1871083728989824:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1784404930.469313:0:19703:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:2.0:1784404930.472196:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00010000:0.0:1784404930.472353:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.472363:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.472645:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.472651:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.472658:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.472677:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.472688:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.472703:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.472730:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784404930.472768:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404930.472777:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.472790:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.472794:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.472805:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.472846:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.472877:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044ab183d/0x24b3e2e6dcd7a2b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.472898:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.472900:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.472902:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.473172:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.473179:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473187:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.473191:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.473195:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473204:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473212:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473219:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473239:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784404930.473756:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.473763:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473777:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.473781:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.473785:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473795:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473803:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473810:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.473823:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784404930.474170:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.474176:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474184:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.474187:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.474192:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474201:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474223:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474230:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474238:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784404930.474429:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784404930.474437:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474446:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151bc00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.474449:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474457:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474472:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474478:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000779b0292/0x24b3e2e6dcd7a2b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474507:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784404930.474511:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474517:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ba00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.474520:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474528:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474539:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474546:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f0e067/0x24b3e2e6dcd7a2c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474570:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404930.474574:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474580:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.474583:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474601:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474611:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474618:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f82dc6f0/0x24b3e2e6dcd7a2c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.474639:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.474641:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.474643:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.474653:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.474728:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.474735:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474744:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.474747:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.474752:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474762:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474771:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474779:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.474809:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784404930.475188:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.475194:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.475202:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.475204:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.475208:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.475217:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.475224:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.475230:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.475247:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784404930.475628:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784404930.475644:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.475653:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167f000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404930.475656:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.475663:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.475679:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.475686:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7a2ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.475991:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404930.475995:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.476003:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404930.476013:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.476020:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.476030:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.476038:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7a2d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.476053:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404930.476054:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404930.476056:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.476110:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.476116:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476125:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.476134:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.476139:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476149:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476158:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476165:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476314:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784404930.476607:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404930.476612:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.476620:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404930.476624:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784404930.476823:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.476829:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476838:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.476841:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.476845:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476876:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476884:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.476897:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.476907:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.476985:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784404930.477240:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.477246:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477256:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.477258:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.477262:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477275:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404930.477282:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477293:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477300:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477309:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784404930.477428:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404930.477436:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477445:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.477449:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477458:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477483:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477489:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001833cd83/0x24b3e2e6dcd7a2e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477508:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.477510:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.477512:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.477737:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.477743:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477755:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.477758:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.477762:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477771:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477779:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477786:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.477805:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784404930.477968:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404930.477973:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477980:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.477984:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.477991:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478002:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478009:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7b471c7/0x24b3e2e6dcd7a2f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478033:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.478035:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.478036:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.478123:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.478128:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.478130:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784404930.478167:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.478173:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478182:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.478186:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.478190:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478200:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478208:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478215:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478234:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404930.478251:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404930.478258:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.478265:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.478336:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478345:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167fc00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.478354:0:19705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478362:0:19705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478373:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478380:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7a2ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.478394:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.478396:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.478397:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.478486:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.478506:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.478518:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.478525:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae389c19/0x24b3e2e6dcd7a2f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.478603:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.478605:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.478607:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.478989:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.478996:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479005:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.479010:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.479014:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479025:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479033:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479048:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479070:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784404930.479373:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.479629:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479653:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.479656:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.479661:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479673:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479681:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479688:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.479701:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784404930.480084:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.480090:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480104:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.480107:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.480111:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480121:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480129:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480136:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480149:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784404930.480494:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.480500:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480507:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.480510:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.480515:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480524:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480605:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480612:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480620:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784404930.480666:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784404930.480674:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480685:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.480700:0:19706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480710:0:19706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480728:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480741:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a2ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480758:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784404930.480761:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480768:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549a00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.480771:0:19706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480778:0:19706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480789:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480795:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094a0f0a3/0x24b3e2e6dcd7a306 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480817:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784404930.480822:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480829:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.480839:0:19706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480848:0:19706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480886:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480894:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e9e85c/0x24b3e2e6dcd7a30d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480908:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404930.480911:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480917:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784404930.480920:0:19706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480927:0:19706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480937:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480944:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7a314 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.480962:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.480964:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.480966:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.480968:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.480975:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.480975:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.480985:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.480988:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.480992:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.481001:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.481008:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.481015:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.481085:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784404930.481304:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481317:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481331:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7a2dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481350:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404930.481354:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481360:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404930.481364:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481372:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481383:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481390:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d407d000/0x24b3e2e6dcd7a31b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.481400:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404930.481401:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.481523:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.481671:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784404930.481738:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.481745:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.481755:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.481759:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.481764:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.481774:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.481783:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.481791:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.481841:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784404930.482241:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.482247:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482261:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.482264:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.482268:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482288:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482297:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482306:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482332:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784404930.482771:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.482776:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482785:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.482788:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.482792:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482801:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482821:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482827:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.482843:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784404930.483158:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.483163:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483171:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.483174:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.483178:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483185:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483191:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483198:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483215:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784404930.483616:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.483621:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483629:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.483642:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.483646:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483655:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483662:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483668:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.483676:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784404930.484141:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784404930.484150:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484158:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404930.484162:0:19705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484172:0:19705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484189:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484196:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed1eba99/0x24b3e2e6dcd7a322 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484217:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784404930.484221:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484227:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7c00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404930.484231:0:19705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484246:0:19705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484257:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484264:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000139287e4/0x24b3e2e6dcd7a329 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784404930.484528:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.484619:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784404930.484623:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484641:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404930.484645:0:19705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484653:0:19705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484662:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484669:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a330 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484693:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404930.484696:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.484701:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404930.484703:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404930.484709:0:19705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.484712:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484725:0:19705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.484729:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404930.484735:0:19706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484741:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.484747:0:19706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484751:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a337 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484774:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.484775:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.484776:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.484780:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.484789:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc64c4d/0x24b3e2e6dcd7a33e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.484808:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.484810:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.484812:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.484823:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.484834:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.484845:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404930.484845:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404930.484877:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.484890:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.484899:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.484980:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.484999:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404930.485187:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404930.485192:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.485200:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404930.485209:0:19705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.485216:0:19705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.485228:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.485235:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004506fc1e/0x24b3e2e6dcd7a345 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.485250:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.485251:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.485253:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784404930.485683:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.485690:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.485698:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.485702:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.485707:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.485716:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.485723:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.485736:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.485757:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404930.485965:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404930.485971:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.485980:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057a00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404930.485984:0:19706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.485993:0:19706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.486005:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.486013:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003edca432/0x24b3e2e6dcd7a34c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.486031:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.486033:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.486035:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784404930.487071:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784404930.487078:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.487091:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1784404930.487095:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784404930.487100:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.487110:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.487118:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.487126:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404930.487147:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404930.487668:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404930.487675:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.487683:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404930.487687:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.487719:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.487733:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.487740:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a898c39/0x24b3e2e6dcd7a353 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.487757:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.487759:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.487761:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.489055:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.489066:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489081:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.489086:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.489091:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489103:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489112:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489126:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489143:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404930.489260:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404930.489267:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489289:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404930.489294:0:19705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489302:0:19705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489323:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489330:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf15d3ac/0x24b3e2e6dcd7a35a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.489349:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.489351:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404930.489352:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404930.489620:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784404930.490146:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784404930.490159:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.490171:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1784404930.490175:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404930.490180:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.490190:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.490198:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.490205:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404930.490221:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404930.490820:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404930.490827:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.490838:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404930.490842:0:19706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.490880:0:19706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.490897:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.490917:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2526b77/0x24b3e2e6dcd7a361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.490933:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.490935:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.490936:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784404930.491147:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784404930.491154:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.491169:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1784404930.491173:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404930.491177:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.491188:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.491196:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.491204:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404930.491226:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1784404930.491270:0:18661:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1784404930.491365:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1871083728989568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 52686us (53022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404930.491376:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784404930.491427:0:17180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1871083728989568:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784404930.491443:0:17180:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1784404930.491488:0:17180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1871083728989952:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784404930.491535:0:17180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.491561:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c580840 going to sleep for 11 seconds 00000100:00100000:1.0:1784404930.491583:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728989952 00000100:00100000:1.0:1784404930.491589:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728989952 00000100:00100000:1.0:1784404930.491624:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784404930.491646:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17180:x1871083728989952:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1784404930.491649:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404930.491657:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.491666:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404930.491669:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.491677:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784404930.491685:0:19139:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1784404930.491703:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.491712:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078195ff2/0x24b3e2e6dcd7a368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404930.491729:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.491732:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404930.491734:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784404930.501396:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1784404930.527550:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:1.0:1784404930.527587:0:19474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1784404930.527622:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1784404930.527628:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784404930.536736:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17897:x1871083728989824:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67463us (72470us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1784404930.536751:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784404930.537091:0:17180:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784404930.537100:0:17180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17180:1871083728989952:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784404930.537116:0:17180:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:1.0:1784404930.538931:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17180:x1871083728989952:12345-0@lo:5:osp-pre-1-0.0 Request processed in 47290us (47387us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784404930.538946:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784404930.539005:0:17897:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1784404930.539013:0:17897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17897:1871083728989824:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1784404930.539027:0:17897:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1784404930.539081:0:17897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17897:1871083728990080:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1784404930.539135:0:17897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404930.539168:0:17897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c5803c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404930.539197:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990080 00000100:00100000:0.0:1784404930.539206:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990080 00000100:00100000:0.0:1784404930.539251:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784404930.539267:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17897:x1871083728990080:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1784404930.539336:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17897:x1871083728990080:12345-0@lo:900:osp-pre-1-1.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404930.539342:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784404930.539508:0:17897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348ea00 x1871083728990080/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784404946 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404930.539521:0:17897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17897:1871083728990080:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1784404930.884882:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404931.920088:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404932.937407:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784404932.996339:0:19833:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784404933.507025:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404933.507047:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728990208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404933.507117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404933.507159:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990208 00000100:00100000:3.0:1784404933.507165:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990208 00000100:00100000:3.0:1784404933.507212:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404933.507223:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728990208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404933.507251:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784404933.507308:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728990208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404933.507315:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1784404933.507336:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404933.507381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728990208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404933.511165:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728990336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404933.511241:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404933.511315:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990336 00000100:00100000:1.0:1784404933.511324:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990336 00000100:00100000:1.0:1784404933.511401:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784404933.511410:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728990336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784404933.511439:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784404933.511633:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728990336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404933.511641:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784404933.511703:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728990336:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784404933.512007:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784404933.962935:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784404934.072394:0:19886:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784404934.072803:0:19886:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784404934.540367:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728990592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404934.540434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404934.540488:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404934.540494:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728990464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404934.540513:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404934.540543:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990592 00000100:00100000:0.0:1784404934.540551:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990592 00000100:00100000:0.0:1784404934.540589:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990464 00000100:00100000:0.0:1784404934.540592:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990464 00000100:00100000:0.0:1784404934.540620:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784404934.540628:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728990592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404934.540673:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784404934.540720:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728990592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404934.540727:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784404934.540756:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784404934.540761:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728990464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404934.540775:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784404934.540797:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728990464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 36us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404934.540803:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784404934.540877:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728990464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404934.540889:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728990592:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784404934.979298:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784404935.065697:0:19936:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784404935.065968:0:19936:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784404935.343114:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404935.343394:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707942656 00000100:00100000:0.0:1784404935.343404:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707942656 00000100:00100000:0.0:1784404935.343462:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:0.0:1784404935.343471:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1871083707942656:12345-192.168.202.42@tcp:250:mount.lustre.0 00010000:00080000:0.0:1784404935.343501:0:17149:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242@192.168.202.42@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1784404935.343532:0:17149:0:(genops.c:1385:class_connect()) connect: client 18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242, cookie 0x24b3e2e6dcd7a36f 00000100:00080000:0.0:1784404935.343700:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9dd441a2b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404935.343781:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+5:2400:x1871083707942656:12345-192.168.202.42@tcp:250:mount.lustre.0 Request processed in 309us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404935.343790:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 114 00000100:00100000:2.0:1784404935.357391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.357506:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707942784 00000100:00100000:1.0:1784404935.357518:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707942784 00000100:00100000:1.0:1784404935.357597:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:1.0:1784404935.357610:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+5:14908:x1871083707942784:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784404935.357631:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404935.357696:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031200/0x24b3e2e6dcd7a376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed758d expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404935.357731:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031200/0x24b3e2e6dcd7a376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed758d expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404935.357743:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031200/0x24b3e2e6dcd7a376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed758d expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404935.357753:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031200, rc 0) 00000100:00100000:1.0:1784404935.357821:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+6:14908:x1871083707942784:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 213us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.357831:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:2.0:1784404935.363657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.363872:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707942912 00000100:00100000:1.0:1784404935.363884:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707942912 00000100:00100000:1.0:1784404935.363946:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:1.0:1784404935.363957:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+6:14908:x1871083707942912:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784404935.364102:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+6:14908:x1871083707942912:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 146us (457us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784404935.364112:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 116 00000040:00080000:1.0:1784404935.366113:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784404935.368711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.368993:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943040 00000100:00100000:3.0:1784404935.369005:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943040 00000100:00100000:3.0:1784404935.369080:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:3.0:1784404935.369092:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+6:14908:x1871083707943040:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784404935.369112:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404935.369129:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442056000/0x24b3e2e6dcd7a37d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7594 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.369158:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442056000/0x24b3e2e6dcd7a37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7594 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.369169:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442056000/0x24b3e2e6dcd7a37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7594 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.369200:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056000, rc 0) 00000100:00100000:3.0:1784404935.369259:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+7:14908:x1871083707943040:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 169us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.369266:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:0.0:1784404935.374231:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.374371:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943168 00000100:00100000:3.0:1784404935.374383:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943168 00000100:00100000:3.0:1784404935.374445:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:3.0:1784404935.374457:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+7:14908:x1871083707943168:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784404935.374649:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14908:x1871083707943168:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 195us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.374658:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:2.0:1784404935.386918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.387197:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943296 00000100:00100000:1.0:1784404935.387207:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943296 00000100:00100000:1.0:1784404935.387272:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:1.0:1784404935.387281:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14908:x1871083707943296:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784404935.387428:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14908:x1871083707943296:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 148us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.387436:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:2.0:1784404935.394921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404935.395011:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943424 00000100:00100000:0.0:1784404935.395023:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943424 00000100:00100000:0.0:1784404935.395100:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:0.0:1784404935.395111:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14927:x1871083707943424:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784404935.395292:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14927:x1871083707943424:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 182us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404935.395301:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:0.0:1784404935.428044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.428122:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943552 00000100:00100000:3.0:1784404935.428135:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943552 00000100:00100000:3.0:1784404935.428194:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:3.0:1784404935.428205:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14927:x1871083707943552:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784404935.428382:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14927:x1871083707943552:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 177us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.428390:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:2.0:1784404935.431545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.431904:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943680 00000100:00100000:1.0:1784404935.431915:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943680 00000100:00100000:1.0:1784404935.431977:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:1.0:1784404935.431988:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14927:x1871083707943680:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784404935.432185:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14927:x1871083707943680:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 198us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.432195:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:2.0:1784404935.438187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404935.438351:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943808 00000100:00100000:0.0:1784404935.438361:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943808 00000100:00100000:0.0:1784404935.438454:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:0.0:1784404935.438464:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:14908:x1871083707943808:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784404935.438502:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404935.438733:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548a00/0x24b3e2e6dcd7a384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed75c5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404935.438766:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548a00/0x24b3e2e6dcd7a384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75c5 expref: 9 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404935.438775:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548a00/0x24b3e2e6dcd7a384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75c5 expref: 9 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404935.438783:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548a00, rc 0) 00000100:00100000:0.0:1784404935.438955:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+9:14908:x1871083707943808:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 489us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404935.438963:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:0.0:1784404935.441973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.442064:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707943936 00000100:00100000:3.0:1784404935.442075:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707943936 00000100:00100000:3.0:1784404935.442152:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:3.0:1784404935.442160:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+9:14908:x1871083707943936:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784404935.442181:0:17146:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784404935.442202:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784404935.442209:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784404935.442211:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784404935.442213:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1784404935.442215:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1784404935.443378:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+9:14908:x1871083707943936:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 1209us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.443389:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:2.0:1784404935.447625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404935.447791:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944064 00000100:00100000:0.0:1784404935.447800:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944064 00000100:00100000:1.0:1784404935.448015:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:1.0:1784404935.448027:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+9:14908:x1871083707944064:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784404935.448044:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404935.448062:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed75cc expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404935.448092:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404935.448116:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404935.448124:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031600, rc 0) 00000100:00100000:1.0:1784404935.448235:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14908:x1871083707944064:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 212us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.448242:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:0.0:1784404935.452294:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.452404:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944192 00000100:00100000:3.0:1784404935.452415:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944192 00000100:00100000:3.0:1784404935.452520:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:3.0:1784404935.452531:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14908:x1871083707944192:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784404935.452715:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14908:x1871083707944192:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 186us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.452724:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:2.0:1784404935.457447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.457505:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944320 00000100:00100000:1.0:1784404935.457516:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944320 00000100:00100000:1.0:1784404935.457634:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:1.0:1784404935.457645:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14908:x1871083707944320:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784404935.457814:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14908:x1871083707944320:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 170us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.457822:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:2.0:1784404935.461039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.461114:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944448 00000100:00100000:3.0:1784404935.461124:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944448 00000100:00100000:3.0:1784404935.461177:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:3.0:1784404935.461187:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14933:x1871083707944448:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784404935.461346:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14933:x1871083707944448:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 159us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.461354:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:2.0:1784404935.468213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.468677:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944576 00000100:00100000:1.0:1784404935.468691:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944576 00000100:00100000:1.0:1784404935.468768:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:1.0:1784404935.468780:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14933:x1871083707944576:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784404935.469002:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:14933:x1871083707944576:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 224us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.469012:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:2.0:1784404935.484561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404935.484672:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944704 00000100:00100000:0.0:1784404935.484683:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944704 00000100:00100000:0.0:1784404935.484741:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784404935.484750:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1871083707944704:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784404935.484785:0:17153:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 0a674842-02a6-4a6f-8c44-65f09b70250a@192.168.202.42@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1784404935.484847:0:17153:0:(genops.c:1385:class_connect()) connect: client 0a674842-02a6-4a6f-8c44-65f09b70250a, cookie 0x24b3e2e6dcd7a392 00000004:00100000:0.0:1784404935.484906:0:17153:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784404935.485143:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9dd441a2a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404935.485217:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2400:x1871083707944704:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 466us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404935.485242:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1784404935.485374:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.485461:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944960 00000100:00100000:1.0:1784404935.485466:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944960 00000100:00100000:1.0:1784404935.485507:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:1.0:1784404935.485514:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1871083707944960:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784404935.485540:0:17155:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 0a674842-02a6-4a6f-8c44-65f09b70250a@192.168.202.42@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:1.0:1784404935.485575:0:17155:0:(genops.c:1385:class_connect()) connect: client 0a674842-02a6-4a6f-8c44-65f09b70250a, cookie 0x24b3e2e6dcd7a399 00000004:00100000:1.0:1784404935.485602:0:17155:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784404935.485754:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9dd442081000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404935.485789:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2400:x1871083707944960:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 274us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.485796:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:2.0:1784404935.509136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.509607:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945216 00000100:00100000:1.0:1784404935.509618:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945216 00000100:00100000:1.0:1784404935.509740:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:1.0:1784404935.509752:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945216:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404935.509805:0:18438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784404935.509952:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945216:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 202us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.509960:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00080000:2.0:1784404935.510409:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404935.513217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404935.513261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.513463:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707944832 00000100:00100000:1.0:1784404935.513473:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707944832 00000100:00100000:1.0:1784404935.513533:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945088 00000100:00100000:1.0:1784404935.513537:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945088 00000100:00100000:1.0:1784404935.513575:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784404935.513595:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:0:x1871083707944832:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404935.513628:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784404935.513694:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:0:x1871083707944832:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 111us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.513702:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784404935.513737:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1784404935.513745:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:0:x1871083707945088:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404935.513764:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784404935.513811:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:0:x1871083707945088:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 66us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.513817:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00080000:0.0:1784404935.514543:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784404935.518748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.518877:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945344 00000100:00100000:1.0:1784404935.518887:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945344 00000100:00100000:1.0:1784404935.519083:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:1.0:1784404935.519095:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945344:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784404935.519198:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945344:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 106us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.519203:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:2.0:1784404935.523146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404935.523220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404935.523303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.523460:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945472 00000100:00100000:3.0:1784404935.523474:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945472 00000100:00100000:3.0:1784404935.523529:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945600 00000100:00100000:3.0:1784404935.523532:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945600 00000100:00100000:3.0:1784404935.523552:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1784404935.523576:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1871083707945472:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784404935.523631:0:18660:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 0a674842-02a6-4a6f-8c44-65f09b70250a@192.168.202.42@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1784404935.523670:0:18660:0:(genops.c:1385:class_connect()) connect: client 0a674842-02a6-4a6f-8c44-65f09b70250a, cookie 0x24b3e2e6dcd7a3a0 00002000:00100000:3.0:1784404935.523686:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0a674842-02a6-4a6f-8c44-65f09b70250a/ffff9dd54851e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784404935.523710:0:18660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1784404935.524392:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784404935.524400:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1871083707945600:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784404935.524424:0:18662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 0a674842-02a6-4a6f-8c44-65f09b70250a@192.168.202.42@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:1.0:1784404935.524445:0:18662:0:(genops.c:1385:class_connect()) connect: client 0a674842-02a6-4a6f-8c44-65f09b70250a, cookie 0x24b3e2e6dcd7a3a7 00002000:00100000:1.0:1784404935.524452:0:18662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0a674842-02a6-4a6f-8c44-65f09b70250a/ffff9dd442080800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784404935.524468:0:18662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784404935.524648:0:18662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784404935.524694:0:18662:0:(import.c:65:import_set_state_nolock()) ffff9dd442081800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784404935.524774:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2400:x1871083707945600:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 372us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404935.524782:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1784404935.525471:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945728 00000100:00100000:0.0:1784404935.525477:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945728 00000100:00100000:0.0:1784404935.525525:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1784404935.525534:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945728:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784404935.525573:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945728:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 42us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404935.525578:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00002000:00080000:2.0:1784404935.526786:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784404935.526839:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9dd4433fc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404935.526934:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2400:x1871083707945472:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 3356us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404935.527559:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1784404935.529636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404935.530170:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945856 00000100:00100000:1.0:1784404935.530184:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945856 00000100:00100000:1.0:1784404935.530258:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1784404935.530271:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945856:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00080000:2.0:1784404935.531708:0:17156:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1321us 00000004:00200000:3.0:1784404935.554471:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784404935.554644:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14908:x1871083707945856:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 24370us (25012us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.554659:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:3.0:1784404935.560027:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728990848:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560166:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728991360:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560465:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728991872:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560536:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1784404935.560543:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728990720:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560607:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728991232:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560648:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728991744:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560688:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728992256:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560767:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728990976:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560811:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728991488:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560845:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728992000:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560900:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784404935.560915:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728991104:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.560936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.560962:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728991616:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.561200:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.561234:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728992128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.561256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.561282:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990848 00000100:00100000:3.0:1784404935.561290:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990848 00000100:00100000:3.0:1784404935.561347:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728991360 00000100:00100000:3.0:1784404935.561350:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728991360 00000100:00100000:3.0:1784404935.561367:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784404935.561374:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728990848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.561623:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728990848:12345-0@lo:400:kworker.0 Request processed in 247us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.561631:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784404935.561652:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784404935.561658:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728991360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.561704:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728991360:12345-0@lo:400:kworker.0 Request processed in 46us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.561710:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784404935.561734:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728991872 00000100:00100000:3.0:1784404935.561738:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728991872 00000100:00100000:3.0:1784404935.561770:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728991232 00000100:00100000:3.0:1784404935.561773:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728991232 00000100:00100000:3.0:1784404935.561783:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728991744 00000100:00100000:3.0:1784404935.561785:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728991744 00000100:00100000:3.0:1784404935.561795:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992256 00000100:00100000:3.0:1784404935.561797:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992256 00000100:00100000:3.0:1784404935.561808:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992000 00000100:00100000:3.0:1784404935.561811:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992000 00000100:00100000:3.0:1784404935.561823:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992128 00000100:00100000:3.0:1784404935.561825:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992128 00000100:00100000:3.0:1784404935.561840:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784404935.561846:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728991872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.562010:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083728991872:12345-0@lo:400:kworker.0 Request processed in 163us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.562017:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784404935.562031:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784404935.562037:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728991232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.562066:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083728991232:12345-0@lo:400:kworker.0 Request processed in 30us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.562071:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784404935.562082:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784404935.562088:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728991744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.562126:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728991744:12345-0@lo:400:kworker.0 Request processed in 38us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.562139:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784404935.562152:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784404935.562159:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728992256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.562190:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728992256:12345-0@lo:400:kworker.0 Request processed in 32us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.562196:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784404935.562218:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784404935.562225:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728992000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.562261:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083728992000:12345-0@lo:400:kworker.0 Request processed in 37us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.562267:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784404935.562278:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784404935.562284:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728992128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.562312:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728992128:12345-0@lo:400:kworker.0 Request processed in 28us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.562318:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784404935.562337:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990976 00000100:00100000:3.0:1784404935.562340:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990976 00000100:00100000:3.0:1784404935.562366:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728991488 00000100:00100000:3.0:1784404935.562369:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728991488 00000100:00100000:3.0:1784404935.562382:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728991104 00000100:00100000:3.0:1784404935.562385:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728991104 00000100:00100000:3.0:1784404935.562729:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728991616 00000100:00100000:3.0:1784404935.562733:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728991616 00000100:00100000:3.0:1784404935.562749:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404935.562755:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728990976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.562800:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728990976:12345-0@lo:400:kworker.0 Request processed in 45us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.562806:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784404935.562819:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784404935.562825:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728991488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.563270:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728991488:12345-0@lo:400:kworker.0 Request processed in 443us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.563278:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784404935.563292:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404935.563300:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728991104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.563336:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728991104:12345-0@lo:400:kworker.0 Request processed in 39us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.563342:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784404935.563353:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404935.563359:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728991616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.563386:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728991616:12345-0@lo:400:kworker.0 Request processed in 27us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.563782:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784404935.563873:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728991104:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.563891:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728991616:0@lo:400:kworker.0 00010000:00080000:3.0:1784404935.564340:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b99c00 x1871083728992128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404935.564352:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728992128:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.564365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728990976:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.564394:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728991488:0@lo:400:kworker.0 00010000:00080000:3.0:1784404935.564405:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9b800 x1871083728992000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404935.564414:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083728992000:0@lo:400:kworker.0 00010000:00080000:3.0:1784404935.564470:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44242ea00 x1871083728991232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404935.564479:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083728991232:0@lo:400:kworker.0 00010000:00080000:3.0:1784404935.564643:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b99880 x1871083728991744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404935.564652:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728991744:0@lo:400:kworker.0 00010000:00080000:3.0:1784404935.564662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9a680 x1871083728992256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404935.564668:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728992256:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.564680:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728990848:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.564690:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728991360:0@lo:400:kworker.0 00010000:00080000:3.0:1784404935.564699:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573b9b100 x1871083728991872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404935.564707:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083728991872:0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.564737:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728990720 00000100:00100000:3.0:1784404935.564743:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728990720 00000100:00100000:3.0:1784404935.564785:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784404935.564800:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3647:x1871083728990720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404935.564885:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3647:x1871083728990720:12345-0@lo:400:kworker.0 Request processed in 87us (4312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.564890:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784404935.565893:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728992384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404935.566438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404935.566563:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083728990720:0@lo:400:kworker.0 00000100:00100000:2.0:1784404935.566690:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992384 00000100:00100000:2.0:1784404935.566697:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992384 00000100:00100000:2.0:1784404935.566747:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404935.566756:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728992384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404935.566778:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784404935.566827:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728992384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404935.566833:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784404935.567299:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728992384:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784404935.567441:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404935.567447:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404935.567450:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784404935.567453:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404935.567534:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404935.567547:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728992512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404935.567597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404935.567633:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992512 00000100:00100000:0.0:1784404935.567639:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992512 00000100:00100000:0.0:1784404935.567668:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404935.567676:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728992512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404935.567690:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404935.567722:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728992512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404935.567728:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404935.567778:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728992512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404935.727096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404935.727174:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707945984 00000100:00100000:3.0:1784404935.727186:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707945984 00000100:00100000:3.0:1784404935.727408:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1784404935.727420:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:14956:x1871083707945984:12345-192.168.202.42@tcp:101:mkdir.0 00010000:00010000:3.0:1784404935.727442:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404935.727469:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057600/0x24b3e2e6dcd7a3ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed75fd expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.727545:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a3b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.727559:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.727572:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404935.727634:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404935.727638:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404935.728008:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.728038:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057600/0x24b3e2e6dcd7a3ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75fd expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.728057:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75fd expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404935.728066:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404935.728069:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404935.728072:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057800, rc 0) 00000100:00100000:3.0:1784404935.728140:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+7:14956:x1871083707945984:12345-192.168.202.42@tcp:101:mkdir.0 Request processed in 722us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404935.728147:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00010000:00010000:1.0:1784404936.005463:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404937.027531:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784404937.094703:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00000100:00100000:1.0:1784404937.811047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404937.811329:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707946112 00000100:00100000:3.0:1784404937.811338:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707946112 00000100:00100000:3.0:1784404937.811406:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:3.0:1784404937.811418:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+7:15008:x1871083707946112:12345-192.168.202.42@tcp:41:lfs.0 00000004:00000024:3.0:1784404937.811455:0:18438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:0.0:1784404937.811485:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404937.811577:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+7:15008:x1871083707946112:12345-192.168.202.42@tcp:41:lfs.0 Request processed in 151us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404937.811586:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:0.0:1784404937.816423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404937.816602:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707946240 00000100:00100000:2.0:1784404937.816615:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707946240 00000100:00100000:2.0:1784404937.816695:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:2.0:1784404937.816708:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+6:15008:x1871083707946240:12345-192.168.202.42@tcp:41:lfs.0 00000004:00000024:2.0:1784404937.816749:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1784404937.816789:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404937.816870:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+6:15008:x1871083707946240:12345-192.168.202.42@tcp:41:lfs.0 Request processed in 145us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404937.816878:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1784404937.821828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404937.822011:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707946368 00000100:00100000:2.0:1784404937.822022:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707946368 00000100:00100000:2.0:1784404937.822108:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:2.0:1784404937.822119:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a674842-02a6-4a6f-8c44-65f09b70250a+6:15008:x1871083707946368:12345-192.168.202.42@tcp:13:lfs.0 00002000:00000024:2.0:1784404937.822173:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784404937.822876:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a674842-02a6-4a6f-8c44-65f09b70250a+6:15008:x1871083707946368:12345-192.168.202.42@tcp:13:lfs.0 Request processed in 728us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404937.822887:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00080000:0.0:1784404937.822965:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404937.827427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404937.828977:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707946496 00000100:00100000:0.0:1784404937.828991:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707946496 00000100:00100000:0.0:1784404937.829090:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1784404937.829103:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15008:x1871083707946496:12345-192.168.202.42@tcp:13:lfs.0 00002000:00000024:0.0:1784404937.829140:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404937.829272:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15008:x1871083707946496:12345-192.168.202.42@tcp:13:lfs.0 Request processed in 172us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404937.829280:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00080000:2.0:1784404937.829467:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784404938.052279:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404938.058974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404938.059279:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707946624 00000100:00100000:0.0:1784404938.059290:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707946624 00000100:00100000:0.0:1784404938.059354:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:0.0:1784404938.059511:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:15040:x1871083707946624:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784404938.059529:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404938.059550:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd7a3bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7604 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404938.059828:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd7a3bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7604 expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404938.059841:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd7a3bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7604 expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404938.059907:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548400, rc 0) 00000100:00100000:0.0:1784404938.059975:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15040:x1871083707946624:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 613us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.059983:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 131 00000100:00100000:1.0:1784404938.066737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404938.066904:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707946752 00000100:00100000:3.0:1784404938.066916:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707946752 00000100:00100000:3.0:1784404938.066985:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:3.0:1784404938.066997:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15040:x1871083707946752:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784404938.067195:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15040:x1871083707946752:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 200us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404938.067204:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:1.0:1784404938.084295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404938.085004:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707946880 00000100:00100000:0.0:1784404938.085017:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707946880 00000100:00100000:0.0:1784404938.085088:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:0.0:1784404938.085100:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15040:x1871083707946880:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784404938.085283:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15040:x1871083707946880:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 184us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.085291:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:1.0:1784404938.104504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.104909:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947008 00000100:00100000:2.0:1784404938.104920:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947008 00000100:00100000:2.0:1784404938.104984:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:2.0:1784404938.104995:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15047:x1871083707947008:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784404938.105164:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15047:x1871083707947008:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 170us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.105172:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:1.0:1784404938.139816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404938.140174:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947136 00000100:00100000:3.0:1784404938.140185:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947136 00000100:00100000:3.0:1784404938.140305:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:3.0:1784404938.140317:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15047:x1871083707947136:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784404938.140480:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15047:x1871083707947136:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 165us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404938.140489:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:1.0:1784404938.144445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404938.149146:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947264 00000100:00100000:0.0:1784404938.149164:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947264 00000100:00100000:0.0:1784404938.149370:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:0.0:1784404938.149383:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15047:x1871083707947264:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784404938.149579:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15047:x1871083707947264:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 198us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.149589:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:1.0:1784404938.156330:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404938.156426:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947392 00000100:00100000:3.0:1784404938.156438:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947392 00000100:00100000:3.0:1784404938.156509:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:3.0:1784404938.156520:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:15040:x1871083707947392:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784404938.156539:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404938.156558:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442057600/0x24b3e2e6dcd7a3c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7635 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.156604:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057600/0x24b3e2e6dcd7a3c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7635 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.156616:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442057600/0x24b3e2e6dcd7a3c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7635 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.156625:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057600, rc 0) 00000100:00100000:3.0:1784404938.156688:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:15040:x1871083707947392:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 170us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404938.156715:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:1.0:1784404938.163368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404938.164185:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947520 00000100:00100000:0.0:1784404938.164197:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947520 00000100:00100000:0.0:1784404938.164268:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:0.0:1784404938.164280:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:15040:x1871083707947520:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784404938.164306:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784404938.164333:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784404938.164342:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784404938.164345:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784404938.164348:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784404938.164351:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1784404938.168035:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:15040:x1871083707947520:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 3745us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.168051:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:1.0:1784404938.178184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.178301:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947648 00000100:00100000:2.0:1784404938.178312:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947648 00000100:00100000:2.0:1784404938.178373:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:2.0:1784404938.178385:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:15040:x1871083707947648:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784404938.178401:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404938.178418:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed763c expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404938.178446:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404938.178457:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404938.178498:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e000, rc 0) 00000100:00100000:2.0:1784404938.178572:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15040:x1871083707947648:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 179us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.178580:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:1.0:1784404938.183172:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404938.187402:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947776 00000100:00100000:0.0:1784404938.187425:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947776 00000100:00100000:0.0:1784404938.187977:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:0.0:1784404938.187990:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15040:x1871083707947776:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784404938.189454:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15040:x1871083707947776:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 1457us (6280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.189474:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:1.0:1784404938.212493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404938.213200:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707947904 00000100:00100000:3.0:1784404938.213211:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707947904 00000100:00100000:3.0:1784404938.213292:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:3.0:1784404938.213303:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15040:x1871083707947904:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784404938.213486:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15040:x1871083707947904:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 183us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404938.213494:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:1.0:1784404938.231255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404938.231546:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948032 00000100:00100000:0.0:1784404938.231556:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948032 00000100:00100000:0.0:1784404938.231621:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:0.0:1784404938.231630:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15052:x1871083707948032:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784404938.231807:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15052:x1871083707948032:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 177us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.231816:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:1.0:1784404938.256677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.256786:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948160 00000100:00100000:2.0:1784404938.256795:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948160 00000100:00100000:2.0:1784404938.256880:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:2.0:1784404938.256891:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15052:x1871083707948160:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784404938.257914:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:15052:x1871083707948160:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 1020us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.257925:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:2.0:1784404938.278706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.278746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.278798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.278838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.278896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.278917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.278945:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949184 00000100:00100000:2.0:1784404938.278955:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949184 00000100:00100000:2.0:1784404938.279007:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949312 00000100:00100000:2.0:1784404938.279010:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949312 00000100:00100000:2.0:1784404938.279033:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1784404938.279043:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2401:x1871083707949184:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404938.279115:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2401:x1871083707949184:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.279133:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1784404938.279152:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:2.0:1784404938.279159:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2401:x1871083707949312:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404938.279186:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2401:x1871083707949312:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.279192:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:0.0:1784404938.279377:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948288 00000100:00100000:0.0:1784404938.279382:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948288 00000100:00100000:0.0:1784404938.279399:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948544 00000100:00100000:0.0:1784404938.279402:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948544 00000100:00100000:0.0:1784404938.279410:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948928 00000100:00100000:0.0:1784404938.279412:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948928 00000100:00100000:0.0:1784404938.279430:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949056 00000100:00100000:0.0:1784404938.279439:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949056 00000100:00100000:0.0:1784404938.279461:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1784404938.279468:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+7:2401:x1871083707948928:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404938.279516:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+7:2401:x1871083707948928:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 49us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.279522:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1784404938.279538:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:0.0:1784404938.279545:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2401:x1871083707949056:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404938.279585:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2401:x1871083707949056:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 40us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.279592:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:0.0:1784404938.279606:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1784404938.279610:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1871083707948288:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784404938.279634:0:17154:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from c32ec117-73b3-46ba-ae0b-cf093b27aaed@192.168.202.42@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1784404938.279673:0:17154:0:(genops.c:1385:class_connect()) connect: client c32ec117-73b3-46ba-ae0b-cf093b27aaed, cookie 0x24b3e2e6dcd7a3d1 00000004:00100000:0.0:1784404938.279698:0:17154:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784404938.279790:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9dd441a28800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404938.279822:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2400:x1871083707948288:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 210us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.279829:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1784404938.279843:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1784404938.279847:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1871083707948544:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784404938.279891:0:17154:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from c32ec117-73b3-46ba-ae0b-cf093b27aaed@192.168.202.42@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1784404938.279915:0:17154:0:(genops.c:1385:class_connect()) connect: client c32ec117-73b3-46ba-ae0b-cf093b27aaed, cookie 0x24b3e2e6dcd7a3d8 00000004:00100000:0.0:1784404938.279932:0:17154:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784404938.279982:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9dd573846000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784404938.280008:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2400:x1871083707948544:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 158us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404938.280014:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:2.0:1784404938.298479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.298519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.298549:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404938.298657:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948416 00000100:00100000:1.0:1784404938.298667:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948416 00000100:00100000:1.0:1784404938.298731:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948672 00000100:00100000:1.0:1784404938.298734:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948672 00000100:00100000:1.0:1784404938.298747:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707948800 00000100:00100000:1.0:1784404938.298749:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707948800 00000100:00100000:1.0:1784404938.298763:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404938.298771:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+7:0:x1871083707948416:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404938.298829:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784404938.298932:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+7:0:x1871083707948416:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 161us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404938.298940:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:1.0:1784404938.298960:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1784404938.298967:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:0:x1871083707948672:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404938.298984:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784404938.299005:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:0:x1871083707948672:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 39us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404938.299011:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:1.0:1784404938.299022:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784404938.299028:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707948800:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784404938.299036:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784404938.299053:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707948800:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404938.299058:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00080000:2.0:1784404938.299227:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404938.299232:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784404938.303475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404938.303624:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949440 00000100:00100000:1.0:1784404938.303634:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949440 00000100:00100000:1.0:1784404938.303697:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1784404938.303710:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707949440:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784404938.303801:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707949440:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 94us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404938.303811:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1784404938.305697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404938.305749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404938.305893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.306300:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949568 00000100:00100000:2.0:1784404938.306311:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949568 00000100:00100000:2.0:1784404938.306355:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949696 00000100:00100000:2.0:1784404938.306359:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949696 00000100:00100000:2.0:1784404938.306376:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784404938.306385:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1871083707949568:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784404938.306418:0:19703:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c32ec117-73b3-46ba-ae0b-cf093b27aaed@192.168.202.42@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1784404938.306451:0:19703:0:(genops.c:1385:class_connect()) connect: client c32ec117-73b3-46ba-ae0b-cf093b27aaed, cookie 0x24b3e2e6dcd7a3df 00002000:00100000:2.0:1784404938.306472:0:19703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c32ec117-73b3-46ba-ae0b-cf093b27aaed/ffff9dd4433fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784404938.306483:0:19703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784404938.306579:0:19703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784404938.306612:0:19703:0:(import.c:65:import_set_state_nolock()) ffff9dd4433fe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404938.306674:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2400:x1871083707949568:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 289us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.306692:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784404938.306709:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1784404938.306714:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1871083707949696:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784404938.306729:0:19703:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c32ec117-73b3-46ba-ae0b-cf093b27aaed@192.168.202.42@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1784404938.306760:0:19703:0:(genops.c:1385:class_connect()) connect: client c32ec117-73b3-46ba-ae0b-cf093b27aaed, cookie 0x24b3e2e6dcd7a3e6 00002000:00100000:2.0:1784404938.306765:0:19703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c32ec117-73b3-46ba-ae0b-cf093b27aaed/ffff9dd4433f9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784404938.306771:0:19703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784404938.306815:0:19703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784404938.306829:0:19703:0:(import.c:65:import_set_state_nolock()) ffff9dd4433ff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784404938.306891:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2400:x1871083707949696:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 175us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.306898:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:0.0:1784404938.313020:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949824 00000100:00100000:0.0:1784404938.313189:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949824 00000100:00100000:2.0:1784404938.313496:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:2.0:1784404938.313507:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707949824:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784404938.313614:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707949824:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 108us (7863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.313621:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:1.0:1784404938.324130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404938.324985:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707949952 00000100:00100000:2.0:1784404938.324999:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707949952 00000100:00100000:2.0:1784404938.325063:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:2.0:1784404938.325075:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707949952:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784404938.325182:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784404938.325334:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15040:x1871083707949952:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 260us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404938.325358:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:0.0:1784404938.509665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404938.509819:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950080 00000100:00100000:3.0:1784404938.509829:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950080 00000100:00100000:3.0:1784404938.509933:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:3.0:1784404938.509944:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15075:x1871083707950080:12345-192.168.202.42@tcp:101:mkdir.0 00010000:00010000:3.0:1784404938.509967:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404938.509989:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057400/0x24b3e2e6dcd7a3ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed766d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.510073:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.510088:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.510101:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404938.510431:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404938.510436:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404938.510476:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.510511:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057400/0x24b3e2e6dcd7a3ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.510530:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404938.510539:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404938.510542:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404938.510545:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056600, rc 0) 00000100:00100000:3.0:1784404938.510679:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+7:15075:x1871083707950080:12345-192.168.202.42@tcp:101:mkdir.0 Request processed in 736us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404938.510686:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1784404938.627778:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728992640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404938.627873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404938.628122:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404938.628132:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728992768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404938.628160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404938.628230:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992640 00000100:00100000:1.0:1784404938.628237:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992640 00000100:00100000:1.0:1784404938.628298:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992768 00000100:00100000:1.0:1784404938.628301:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992768 00000100:00100000:1.0:1784404938.628321:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404938.628330:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728992640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784404938.628353:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784404938.628395:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083728992640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404938.628403:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404938.628420:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404938.628426:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728992768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404938.628435:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784404938.628461:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728992768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404938.628467:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404938.628508:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728992768:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784404938.628576:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404938.628637:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083728992640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784404939.076067:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404939.651019:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728992896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404939.651098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404939.651175:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728992896 00000100:00100000:0.0:1784404939.651184:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728992896 00000100:00100000:0.0:1784404939.651232:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404939.651241:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728992896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404939.651276:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784404939.651337:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728992896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404939.651344:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404939.651390:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728992896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404939.652732:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728993024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404939.652777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404939.652907:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993024 00000100:00100000:0.0:1784404939.652913:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993024 00000100:00100000:0.0:1784404939.652962:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784404939.652971:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728993024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784404939.652998:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784404939.667252:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728993024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 14273us (14464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404939.667267:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784404939.672989:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728993024:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784404940.100249:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404940.675332:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784404940.675358:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728993664:0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.675436:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404940.675476:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728993280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404940.675498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404940.675515:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728993152:0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.675570:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993664 00000100:00100000:1.0:1784404940.675578:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404940.675580:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993664 00000100:00100000:1.0:1784404940.675614:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728994176:0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.675636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404940.675647:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994176 00000100:00100000:3.0:1784404940.675652:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994176 00000100:00100000:1.0:1784404940.675657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728994688:0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.675694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404940.675698:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784404940.675711:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728993664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.675720:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784404940.675728:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728993792:0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.675750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404940.675771:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728994304:0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.675785:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728993664:12345-0@lo:400:kworker.0 Request processed in 76us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.675798:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404940.675801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404940.675821:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404940.675827:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728994816:0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.675832:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728994176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.675892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404940.675906:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728994176:12345-0@lo:400:kworker.0 Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.675913:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404940.675932:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728994176:0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.675933:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993152 00000100:00100000:3.0:1784404940.675938:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993152 00000100:00100000:1.0:1784404940.675947:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728993664:0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.675982:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993280 00000100:00100000:3.0:1784404940.675983:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784404940.675987:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993280 00000100:00100000:3.0:1784404940.675995:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083728993152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.676022:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784404940.676031:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728993280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404940.676037:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083728993152:12345-0@lo:400:kworker.0 Request processed in 45us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.676044:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00002000:00000024:1.0:1784404940.676055:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1784404940.676077:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404940.676092:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728993280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.676098:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994688 00000100:00100000:1.0:1784404940.676102:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784404940.676104:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994688 00000100:00100000:1.0:1784404940.676138:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993792 00000100:00100000:3.0:1784404940.676140:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994304 00000100:00100000:1.0:1784404940.676143:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993792 00000100:00100000:3.0:1784404940.676145:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994304 00000100:00100000:1.0:1784404940.676165:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994816 00000100:00100000:3.0:1784404940.676171:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404940.676176:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994816 00000100:00100000:3.0:1784404940.676183:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728994688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.676206:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784404940.676215:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728993792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.676223:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083728994688:12345-0@lo:400:kworker.0 Request processed in 41us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.676231:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784404940.676247:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784404940.676256:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728994304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.676259:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083728993792:12345-0@lo:400:kworker.0 Request processed in 45us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404940.676268:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784404940.676284:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784404940.676291:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728994816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784404940.676385:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784404940.676390:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404940.676510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728993408:0@lo:400:kworker.0 00000100:00100000:2.0:1784404940.677703:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728993536:0@lo:400:kworker.0 00000100:00100000:1.0:1784404940.677840:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083728994816:12345-0@lo:400:kworker.0 Request processed in 1547us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404940.677876:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784404940.677941:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083728993792:0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.679820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404940.679901:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728993920:0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.679935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404940.679968:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728994432:0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.679994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404940.680028:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404940.680053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404940.680142:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993408 00000100:00100000:0.0:1784404940.680150:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993408 00000100:00100000:0.0:1784404940.680194:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993920 00000100:00100000:0.0:1784404940.680197:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993920 00000100:00100000:0.0:1784404940.680213:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784404940.680237:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728993408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.680300:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728993408:12345-0@lo:400:kworker.0 Request processed in 64us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404940.680308:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784404940.680324:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784404940.680330:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728993920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.680359:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728993920:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404940.680365:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784404940.680385:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994944 00000100:00100000:0.0:1784404940.680388:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994944 00000100:00100000:0.0:1784404940.680414:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784404940.680420:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728994944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404940.680454:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404940.680489:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728994944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404940.680495:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784404940.680759:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994432 00000100:00100000:0.0:1784404940.680762:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994432 00000100:00100000:0.0:1784404940.680804:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784404940.680811:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728994432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.680842:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083728994432:12345-0@lo:400:kworker.0 Request processed in 32us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404940.680848:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784404940.680915:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404940.680927:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728993408:0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.680935:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728993920:0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.680944:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083728994432:0@lo:400:kworker.0 00000100:00080000:0.0:1784404940.681075:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404940.681802:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083728994304:12345-0@lo:400:kworker.0 Request processed in 5542us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.681811:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784404940.682582:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083728994304:0@lo:400:kworker.0 00010000:00080000:3.0:1784404940.682606:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541327480 x1871083728994816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404940.682625:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083728994816:0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.682640:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083728994688:0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.682661:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728993280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404940.682671:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083728993152:0@lo:400:kworker.0 00000100:00100000:2.0:1784404940.682939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404940.682975:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728994048:0@lo:400:kworker.0 00000100:00100000:2.0:1784404940.683002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404940.683018:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728994560:0@lo:400:kworker.0 00000100:00100000:2.0:1784404940.683039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404940.683597:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728993536 00000100:00100000:3.0:1784404940.683605:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728993536 00000100:00100000:3.0:1784404940.683653:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994048 00000100:00100000:3.0:1784404940.683657:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994048 00000100:00100000:3.0:1784404940.683758:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404940.683770:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728993536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.683886:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728993536:12345-0@lo:400:kworker.0 Request processed in 108us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.683895:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784404940.683917:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784404940.683925:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728994048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404940.683954:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728994048:12345-0@lo:400:kworker.0 Request processed in 31us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404940.683960:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1784404940.684007:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404940.684526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728993536:0@lo:400:kworker.0 00000100:00100000:2.0:1784404940.684551:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728994048:0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.686837:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728994560 00000100:00100000:0.0:1784404940.688805:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728994560 00000100:00100000:0.0:1784404940.688929:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784404940.688940:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728994560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404940.689040:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083728994560:12345-0@lo:400:kworker.0 Request processed in 102us (5999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404940.689048:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1784404940.689413:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd541325880 x1871083728994560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404940.689431:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083728994560:0@lo:400:kworker.0 00000100:00080000:3.0:1784404940.689808:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1784404940.739623:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1784404941.058527:0:20034:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784404941.124890:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784404941.195202:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000001:00100000:2.0:1784404941.195303:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00000001:00100000:1.0:1784404941.202078:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000001:00100000:1.0:1784404941.202089:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00000001:00100000:0.0:1784404941.202400:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000001:00100000:0.0:1784404941.202413:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00010000:00010000:0.0:1784404942.148766:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404943.180968:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404943.573628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.573673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.573699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.573719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.573742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.573774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404943.573823:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950208 00000100:00100000:3.0:1784404943.573834:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950208 00000100:00100000:3.0:1784404943.573929:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:3.0:1784404943.573940:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2403:x1871083707950208:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404943.574021:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2403:x1871083707950208:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 83us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404943.574030:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 145 00000100:00100000:3.0:1784404943.574062:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950720 00000100:00100000:3.0:1784404943.574066:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950720 00000100:00100000:3.0:1784404943.574097:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707951232 00000100:00100000:3.0:1784404943.574100:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707951232 00000100:00100000:3.0:1784404943.574118:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:3.0:1784404943.574126:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707950720:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404943.574155:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707950720:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404943.574162:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:3.0:1784404943.574178:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:3.0:1784404943.574185:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2403:x1871083707951232:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404943.574223:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2403:x1871083707951232:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 39us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404943.574230:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00080000:3.0:1784404943.574359:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404943.574818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.574920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.574947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404943.578597:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950464 00000100:00100000:1.0:1784404943.578614:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950464 00000100:00100000:1.0:1784404943.578675:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950976 00000100:00100000:1.0:1784404943.578679:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950976 00000100:00100000:1.0:1784404943.578693:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950336 00000100:00100000:1.0:1784404943.578696:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950336 00000100:00100000:1.0:1784404943.578712:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950848 00000100:00100000:1.0:1784404943.578715:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950848 00000100:00100000:1.0:1784404943.578737:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:1.0:1784404943.578746:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707950464:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404943.578869:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707950464:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 122us (5194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404943.578878:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:1.0:1784404943.578902:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:1.0:1784404943.578923:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707950976:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404943.578950:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707950976:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404943.579129:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:0.0:1784404943.581369:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:0.0:1784404943.581403:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2403:x1871083707950336:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404943.581479:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2403:x1871083707950336:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 97us (7704us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404943.581487:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:0.0:1784404943.581536:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:0.0:1784404943.581545:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2403:x1871083707950848:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404943.582268:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2403:x1871083707950848:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 723us (7345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404943.582276:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:3.0:1784404943.584372:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707950592 00000100:00100000:3.0:1784404943.584386:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707950592 00000100:00100000:3.0:1784404943.584532:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707951104 00000100:00100000:3.0:1784404943.584536:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707951104 00000100:00100000:3.0:1784404943.584571:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1784404943.584583:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707950592:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404943.584656:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707950592:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 75us (9838us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404943.584664:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1784404943.584683:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:3.0:1784404943.584690:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707951104:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404943.584717:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707951104:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (9769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404943.584725:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00080000:3.0:1784404943.584767:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784404943.584774:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404943.584777:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404943.747172:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404943.747209:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728995072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404943.747287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404943.747372:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728995072 00000100:00100000:1.0:1784404943.747380:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728995072 00000100:00100000:1.0:1784404943.747447:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784404943.747456:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728995072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404943.747485:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784404943.747548:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083728995072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404943.747574:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784404943.747623:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083728995072:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784404943.747680:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404943.747928:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728995200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404943.747971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404943.748111:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728995200 00000100:00100000:0.0:1784404943.748117:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728995200 00000100:00100000:0.0:1784404943.748162:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784404943.748169:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728995200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404943.748180:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784404943.748221:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728995200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404943.748228:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784404943.748260:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728995200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784404943.748310:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784404944.196104:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784404944.260573:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000020:00000080:3.0:1784404944.425756:0:20181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8b81a7f0 20000000:00000080:3.0:1784404944.425777:0:20181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd5732cf000 uarg=0000000000000000 20000000:01000000:3.0:1784404944.425829:0:20181:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784404944.425835:0:20181:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784404944.425840:0:20181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784404944.426661:0:20182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1784404944.426839:0:20181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784404944.434489:0:20181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784404944.434530:0:20181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434561:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434569:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434576:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434583:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434592:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434600:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434607:0:20181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434649:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434663:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 12 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404944.434677:0:20181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995328:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404944.434837:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434892:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 12 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404944.434902:0:20181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995456:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404944.434938:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.434946:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404944.434955:0:20181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995584:0@lo:104: 00000100:00100000:3.0:1784404944.434995:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784404944.435040:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.435048:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 23 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404944.435056:0:20181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995712:0@lo:104: 00000100:00100000:3.0:1784404944.435078:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784404944.435102:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.435110:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 23 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404944.435117:0:20181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995840:0@lo:104: 00000100:00100000:3.0:1784404944.435155:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784404944.435180:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.435188:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 23 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404944.435208:0:20181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995968:0@lo:104: 00000100:00100000:3.0:1784404944.435230:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404944.435240:0:20181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac780 going to sleep for 11 seconds 00000100:00100000:2.0:1784404944.435452:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728995584 00000100:00100000:2.0:1784404944.435461:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728995584 00000100:00100000:2.0:1784404944.435501:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728995712 00000100:00100000:2.0:1784404944.435504:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728995712 00000100:00100000:2.0:1784404944.435528:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728995840 00000100:00100000:2.0:1784404944.435531:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728995840 00000100:00100000:2.0:1784404944.435539:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728995968 00000100:00100000:2.0:1784404944.435549:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728995968 00000100:00100000:2.0:1784404944.435567:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404944.435575:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+6:20181:x1871083728995584:12345-0@lo:104: 00010000:00010000:2.0:1784404944.435589:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.435656:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784404944.435662:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+6:20181:x1871083728995584:12345-0@lo:104: Request processed in 88us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404944.435668:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784404944.435685:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784404944.435691:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+5:20181:x1871083728995712:12345-0@lo:104: 00010000:00010000:2.0:1784404944.435699:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.435731:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784404944.435736:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+5:20181:x1871083728995712:12345-0@lo:104: Request processed in 46us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404944.435742:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784404944.435755:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784404944.435761:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:20181:x1871083728995840:12345-0@lo:104: 00010000:00010000:2.0:1784404944.435768:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.435801:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784404944.435806:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+4:20181:x1871083728995840:12345-0@lo:104: Request processed in 46us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404944.435812:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784404944.435830:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784404944.435836:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:20181:x1871083728995968:12345-0@lo:104: 00010000:00010000:2.0:1784404944.435843:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.435908:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784404944.435914:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+3:20181:x1871083728995968:12345-0@lo:104: Request processed in 78us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404944.435920:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1784404944.435936:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784404944.435942:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.435949:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540030800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404944.435953:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.435961:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404944.435968:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404944.435974:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404944.435999:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436006:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404944.436025:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436042:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd540030800/0x24b3e2e6dcd7a23b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a242 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436057:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784404944.436060:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436066:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ac00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404944.436069:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436077:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404944.436083:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404944.436088:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404944.436103:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436109:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404944.436124:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436130:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151ac00/0x24b3e2e6dcd7a0d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a0dd expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436139:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784404944.436148:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436153:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404944.436155:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436161:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404944.436167:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404944.436172:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404944.436185:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436191:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404944.436208:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436215:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd54516f600/0x24b3e2e6dcd7a097 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a09e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436225:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404944.436228:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436234:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784404944.436236:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436254:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784404944.436261:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404944.436266:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784404944.436279:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436284:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404944.436290:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.436296:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151b200/0x24b3e2e6dcd7a089 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a090 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404944.436529:0:20181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995584:0@lo:104: 00000100:00100000:3.0:1784404944.436542:0:20181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995712:0@lo:104: 00000100:00100000:3.0:1784404944.436548:0:20181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995840:0@lo:104: 00000100:00100000:3.0:1784404944.436555:0:20181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995968:0@lo:104: 00000100:00100000:1.0:1784404944.437000:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728996224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404944.437048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404944.437086:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404944.437092:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728996352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404944.437112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404944.437139:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996224 00000100:00100000:1.0:1784404944.437144:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996224 00010000:00010000:1.0:1784404944.437169:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 24 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404944.437192:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996352 00000100:00100000:1.0:1784404944.437208:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996352 00010000:00010000:1.0:1784404944.437227:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 25 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404944.437240:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784404944.437246:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+25:3646:x1871083728996224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404944.437257:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404944.437262:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 25 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.437270:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 25 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.437299:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c6200/0x24b3e2e6dcd7a0dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a0d6 expref: 25 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.438601:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404944.438678:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3646:x1871083728996224:12345-0@lo:103:ldlm_bl.0 Request processed in 1428us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404944.438689:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784404944.438719:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784404944.438729:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:3646:x1871083728996352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404944.438742:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404944.438749:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 23 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.438761:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 23 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.438776:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516e600/0x24b3e2e6dcd7a09e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a097 expref: 23 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.438786:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404944.438809:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:3646:x1871083728996352:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404944.438815:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1784404944.438899:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404944.438904:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404944.438909:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404944.439187:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404944.439190:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404944.439192:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404944.439275:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728996096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404944.439584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404944.439635:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404944.439642:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728996480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404944.439664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404944.439740:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728996352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404944.439750:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083728996224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404944.439808:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996096 00000100:00100000:1.0:1784404944.439814:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996096 00010000:00010000:1.0:1784404944.439884:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 22 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404944.439912:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996480 00000100:00100000:1.0:1784404944.439916:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996480 00010000:00010000:1.0:1784404944.439927:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 23 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404944.439939:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404944.439945:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:3649:x1871083728996096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404944.439957:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404944.439962:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.439972:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.439985:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516e200/0x24b3e2e6dcd7a242 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a23b expref: 23 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.439997:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404944.440034:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:3649:x1871083728996096:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404944.440042:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404944.440056:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404944.440062:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573263480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3649:x1871083728996480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404944.440070:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404944.440074:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 21 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.440092:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 21 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.440102:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd548758400/0x24b3e2e6dcd7a090 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a089 expref: 21 pid: 17149 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404944.440111:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404944.440132:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573263480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:3649:x1871083728996480:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404944.440139:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784404944.440223:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728996480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404944.440231:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083728996096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404944.443893:0:20181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995456:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404944.443938:0:20181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1871083728995328:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404944.443982:0:20181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404944.447004:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404944.447086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404944.447250:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707951360 00000100:00100000:3.0:1784404944.447252:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707951488 00000100:00100000:3.0:1784404944.447262:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707951488 00000100:00100000:2.0:1784404944.447262:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707951360 00010000:00010000:2.0:1784404944.447310:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 14 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404944.447364:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 14 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404944.447406:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:2.0:1784404944.447417:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+14:2404:x1871083707951360:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404944.447434:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404944.447440:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 14 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447450:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 14 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447474:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031600/0x24b3e2e6dcd7a38b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75cc expref: 14 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447493:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404944.447564:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2404:x1871083707951360:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 148us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404944.447572:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:2.0:1784404944.447627:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:2.0:1784404944.447635:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:2403:x1871083707951488:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404944.447653:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404944.447659:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 12 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447669:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 12 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447681:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516e000/0x24b3e2e6dcd7a3ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed763c expref: 12 pid: 17147 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447702:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447710:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447725:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447732:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447739:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447746:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447752:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404944.447757:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447764:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447793:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404944.447803:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404944.447832:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:2403:x1871083707951488:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 198us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404944.447844:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00010000:00010000:0.0:1784404944.447928:0:20181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404944.447937:0:20181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404944.447943:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a3fb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404944.771450:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404944.771472:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728996736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404944.771562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404944.771664:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996736 00000100:00100000:0.0:1784404944.771672:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996736 00000100:00100000:1.0:1784404944.771723:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404944.771729:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784404944.771738:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728996608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404944.771740:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728996736:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404944.771778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1784404944.771779:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784404944.771810:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996608 00000100:00100000:1.0:1784404944.771815:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996608 00000100:00100000:0.0:1784404944.771839:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083728996736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404944.771847:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784404944.771964:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083728996736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404944.779605:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784404944.779637:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728996608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404944.779684:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784404944.779784:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083728996608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (8006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404944.779793:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784404944.779888:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083728996608:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784404945.219138:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784404945.476658:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784404945.476666:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd4435d4800 from 13 10000000:01000000:3.0:1784404945.476672:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784404945.476717:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.476729:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.476740:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404945.476766:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728996864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.476834:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.476905:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580acd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404945.477034:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996864 00000100:00100000:0.0:1784404945.477042:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996864 00000100:00100000:0.0:1784404945.477096:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784404945.477106:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:17151:x1871083728996864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404945.477119:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404945.477132:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd7a409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a402 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404945.477154:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd7a409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a402 expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404945.477164:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd7a409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a402 expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404945.477189:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548c00, rc 0) 00000100:00100000:0.0:1784404945.477229:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728996864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.477236:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784404945.477327:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728996864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404945.477342:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.477351:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404945.477482:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728996992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.477517:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.477575:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580acd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404945.482062:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728996992 00000100:00100000:0.0:1784404945.482079:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728996992 00000100:00100000:0.0:1784404945.482140:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784404945.482150:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728996992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404945.482314:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728996992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (4795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.482322:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784404945.482541:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728996992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.482603:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.482663:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.482701:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580acd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784404945.482827:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728997120 00000100:00100000:0.0:1784404945.482832:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728997120 00000100:00100000:0.0:1784404945.482913:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784404945.482920:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728997120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404945.483005:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728997120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.483011:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784404945.483115:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784404945.484966:0:20212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784404945.485130:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784404945.485154:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404945.485164:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.485176:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404945.485186:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784404945.485189:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd573845800 from 13 10000000:01000000:3.0:1784404945.485192:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784404945.485231:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.485239:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.485248:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404945.485273:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.485335:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.485381:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1784404945.485942:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728997248 00000100:00100000:1.0:1784404945.485950:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728997248 00000100:00100000:1.0:1784404945.486002:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784404945.486012:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:17151:x1871083728997248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404945.486025:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404945.486040:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031400/0x24b3e2e6dcd7a417 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a410 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.486065:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031400/0x24b3e2e6dcd7a417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a410 expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.486076:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031400/0x24b3e2e6dcd7a417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a410 expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.486084:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031400, rc 0) 00000100:00100000:1.0:1784404945.486133:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:17151:x1871083728997248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.486140:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784404945.486283:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404945.486299:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.486325:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404945.486388:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.486427:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.486458:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1784404945.486607:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728997376 00000100:00100000:1.0:1784404945.486612:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728997376 00000100:00100000:1.0:1784404945.486672:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784404945.486681:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:17151:x1871083728997376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.486801:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:17151:x1871083728997376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.486808:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784404945.489791:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.489894:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.489980:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.492698:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404945.492831:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728997504 00000100:00100000:0.0:1784404945.492841:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728997504 00000100:00100000:0.0:1784404945.492915:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784404945.492924:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:17151:x1871083728997504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404945.493068:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:17151:x1871083728997504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (3087us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.493074:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784404945.493207:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784404945.495680:0:20213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784404945.495955:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784404945.495979:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784404945.495989:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.496000:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404945.496010:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784404945.496012:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442285000 from 13 10000000:01000000:3.0:1784404945.496014:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784404945.496050:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.496057:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.496079:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404945.496104:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.496169:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.496207:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1784404945.496339:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728997632 00000100:00100000:0.0:1784404945.496346:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728997632 00000100:00100000:0.0:1784404945.496393:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784404945.496415:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:17151:x1871083728997632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784404945.496428:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784404945.496440:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549800/0x24b3e2e6dcd7a425 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a41e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404945.496462:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549800/0x24b3e2e6dcd7a425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a41e expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404945.496472:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549800/0x24b3e2e6dcd7a425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a41e expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404945.496480:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549800, rc 0) 00000100:00100000:0.0:1784404945.496541:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728997632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.496548:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784404945.496627:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784404945.496640:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404945.496649:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404945.496722:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.496748:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.496779:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1784404945.496989:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728997760 00000100:00100000:1.0:1784404945.496994:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728997760 00000100:00100000:1.0:1784404945.497031:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784404945.497037:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728997760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.497168:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728997760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.497175:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784404945.497208:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.497236:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.497274:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.497293:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552680600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404945.497304:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728997888 00000100:00100000:1.0:1784404945.497307:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728997888 00000100:00100000:1.0:1784404945.497323:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784404945.497328:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4437b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728997888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.497422:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4437b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728997888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.497428:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784404945.497583:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728997888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784404945.498251:0:20214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784404945.498301:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784404945.498320:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784404945.498330:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.498340:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404945.498362:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784404945.498364:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd443e83000 from 13 10000000:01000000:1.0:1784404945.498367:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784404945.498389:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.498397:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.498406:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404945.498422:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728998016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.498454:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.498479:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5526800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404945.498493:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998016 00000100:00100000:1.0:1784404945.498508:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998016 00000100:00100000:1.0:1784404945.498534:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784404945.498542:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:17151:x1871083728998016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404945.498554:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404945.498566:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540030600/0x24b3e2e6dcd7a433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a42c expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.498587:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540030600/0x24b3e2e6dcd7a433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a42c expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.498598:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540030600/0x24b3e2e6dcd7a433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a42c expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.498617:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540030600, rc 0) 00000100:00100000:1.0:1784404945.498654:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728998016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.498661:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784404945.498691:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728998016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404945.498710:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.498719:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404945.498759:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728998144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.498782:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.498806:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5526800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404945.499068:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998144 00000100:00100000:0.0:1784404945.499073:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998144 00000100:00100000:0.0:1784404945.499106:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784404945.499113:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728998144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784404945.499223:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728998144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.499230:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784404945.499705:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728998144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.499748:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728998272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784404945.499798:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.499834:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1784404945.499892:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998272 00000100:00100000:0.0:1784404945.499897:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998272 00000100:00100000:0.0:1784404945.499938:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784404945.499952:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728998272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784404945.500037:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:17151:x1871083728998272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.500043:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784404945.500082:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:17151:1871083728998272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784404945.501212:0:20215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784404945.501300:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784404945.501325:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784404945.501335:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404945.501345:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404945.608661:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784404945.795035:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728998400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404945.795109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.795736:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728998528:0@lo:400:kworker.0 00000100:00100000:1.0:1784404945.795787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.795812:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784404945.795818:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728998656:0@lo:400:kworker.0 00000100:00100000:1.0:1784404945.795844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.795900:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998400 00000100:00100000:1.0:1784404945.795906:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998400 00000100:00100000:1.0:1784404945.795960:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784404945.795970:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728998400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404945.796000:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784404945.799930:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998656 00000100:00100000:3.0:1784404945.799970:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998656 00000100:00100000:3.0:1784404945.800037:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784404945.800049:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728998656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.800151:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728998656:12345-0@lo:400:kworker.0 Request processed in 107us (4306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.800161:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784404945.800185:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998528 00000100:00100000:3.0:1784404945.800190:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998528 00000100:00100000:3.0:1784404945.800217:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784404945.800223:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728998528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.800270:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728998528:12345-0@lo:400:kworker.0 Request processed in 34us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.800276:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784404945.800302:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728998784:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.800339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.800369:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784404945.800375:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728998912:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.800397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.800444:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998784 00000100:00100000:3.0:1784404945.800447:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998784 00000100:00100000:3.0:1784404945.800473:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784404945.800479:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5440fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728998784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.800526:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5440fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083728998784:12345-0@lo:400:kworker.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.800533:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784404945.800688:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083728998784:0@lo:400:kworker.0 00000100:00100000:1.0:1784404945.805291:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728998400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9303us (10162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.805306:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784404945.805360:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728999040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404945.805426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.807505:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728998656:0@lo:400:kworker.0 00000100:00100000:1.0:1784404945.807545:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728998528:0@lo:400:kworker.0 00000100:00080000:1.0:1784404945.807597:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404945.807603:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404945.807621:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999040 00000100:00100000:1.0:1784404945.807629:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999040 00000100:00100000:1.0:1784404945.807674:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404945.807682:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728999040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784404945.807711:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784404945.807806:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083728999040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.807813:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784404945.807865:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083728999040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404945.808030:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728998912 00000100:00100000:1.0:1784404945.808035:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728998912 00000100:00100000:1.0:1784404945.808067:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784404945.808073:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728998912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404945.808119:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083728998912:12345-0@lo:400:kworker.0 Request processed in 46us (7720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.808124:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784404945.808266:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083728998912:0@lo:400:kworker.0 00000100:00100000:2.0:1784404945.812367:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728998400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404945.816548:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784404945.816588:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728999424:0@lo:400:kworker.0 00000100:00100000:0.0:1784404945.816614:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728999168:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.827008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.827107:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999424 00000100:00100000:3.0:1784404945.827118:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999424 00000100:00100000:3.0:1784404945.827174:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784404945.828544:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728999424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.828642:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083728999424:12345-0@lo:400:kworker.0 Request processed in 1459us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.828651:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784404945.828709:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083728999424:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.828721:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728999296:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.828764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.831100:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728999936:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.831158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.831179:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784404945.831993:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728999552:0@lo:400:kworker.0 00000100:00100000:1.0:1784404945.832034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404945.832074:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999936 00000100:00100000:1.0:1784404945.832081:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999936 00000100:00100000:1.0:1784404945.832130:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999552 00000100:00100000:1.0:1784404945.832132:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999552 00000100:00100000:1.0:1784404945.832146:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784404945.832154:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728999936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.832476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728999808:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.832493:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784404945.832513:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728999552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.832556:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083728999552:12345-0@lo:400:kworker.0 Request processed in 47us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.832563:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784404945.832607:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083728999552:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.832639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404945.832655:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999808 00000100:00100000:3.0:1784404945.832657:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999808 00000100:00100000:3.0:1784404945.832686:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784404945.832691:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728999808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.832719:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083728999808:12345-0@lo:400:kworker.0 Request processed in 27us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.832725:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784404945.832756:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083728999808:0@lo:400:kworker.0 00000100:00100000:1.0:1784404945.833309:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083728999936:12345-0@lo:400:kworker.0 Request processed in 1154us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.833317:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1784404945.834357:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d31f80 x1871083728999936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404945.834374:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083728999936:0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.835008:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999296 00000100:00100000:3.0:1784404945.835017:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999296 00000100:00100000:3.0:1784404945.835062:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784404945.835069:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728999296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.835145:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083728999296:12345-0@lo:400:kworker.0 Request processed in 76us (6381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.835152:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784404945.835182:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083728999296:0@lo:400:kworker.0 00000100:00080000:2.0:1784404945.837416:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404945.837425:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404945.837429:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404945.839862:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404945.839917:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728999680:0@lo:400:kworker.0 00000100:00100000:0.0:1784404945.839984:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404945.840032:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999168 00000100:00100000:0.0:1784404945.840040:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999168 00000100:00100000:3.0:1784404945.840067:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083728999680 00000100:00100000:3.0:1784404945.840071:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083728999680 00000100:00100000:0.0:1784404945.840082:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784404945.840090:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728999168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.840111:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784404945.840117:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728999680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404945.840149:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083728999680:12345-0@lo:400:kworker.0 Request processed in 32us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404945.840149:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083728999168:12345-0@lo:400:kworker.0 Request processed in 58us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404945.840157:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784404945.840157:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784404945.840198:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083728999168:0@lo:400:kworker.0 00010000:00080000:0.0:1784404945.840210:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d30000 x1871083728999680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404945.840229:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083728999680:0@lo:400:kworker.0 00000100:00080000:2.0:1784404945.840777:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784404945.950021:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404945.953595:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707951616 00000100:00100000:2.0:1784404945.953609:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707951616 00000100:00100000:2.0:1784404945.953673:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 158 00000100:00100000:2.0:1784404945.953684:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:14922:x1871083707951616:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784404945.953700:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404945.953718:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd54516fc00/0x24b3e2e6dcd7a43a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7674 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404945.953747:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd54516fc00/0x24b3e2e6dcd7a43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7674 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404945.953758:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd54516fc00/0x24b3e2e6dcd7a43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7674 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404945.953767:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fc00, rc 0) 00000100:00100000:2.0:1784404945.953834:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:14922:x1871083707951616:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 151us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404945.953841:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 158 00000100:00100000:1.0:1784404945.965090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404945.965168:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707951744 00000100:00100000:2.0:1784404945.965180:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707951744 00000100:00100000:2.0:1784404945.965248:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:2.0:1784404945.965261:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:14922:x1871083707951744:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404945.965414:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:14922:x1871083707951744:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 156us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404945.965423:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 159 00000100:00100000:2.0:1784404945.969013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404945.969090:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707951872 00000100:00100000:1.0:1784404945.969102:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707951872 00000100:00100000:1.0:1784404945.969157:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:1.0:1784404945.969168:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:14922:x1871083707951872:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404945.969329:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:14922:x1871083707951872:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 162us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.969338:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 160 00000100:00100000:1.0:1784404945.991974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404945.992021:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707952000 00000100:00100000:1.0:1784404945.992031:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707952000 00000100:00100000:1.0:1784404945.992080:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:1.0:1784404945.992090:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:14922:x1871083707952000:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784404945.992108:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404945.992132:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd540031e00/0x24b3e2e6dcd7a441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed767b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.992169:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd540031e00/0x24b3e2e6dcd7a441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed767b expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.992179:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd540031e00/0x24b3e2e6dcd7a441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed767b expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404945.992188:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031e00, rc 0) 00000100:00100000:1.0:1784404945.992243:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:14922:x1871083707952000:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 155us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404945.992250:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 161 00000100:00100000:1.0:1784404945.998013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404945.998405:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707952128 00000100:00100000:2.0:1784404945.998414:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707952128 00000100:00100000:2.0:1784404945.998469:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:2.0:1784404945.998479:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4435f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:14922:x1871083707952128:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784404945.998637:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4435f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:14922:x1871083707952128:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 160us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404945.998645:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 162 00000100:00100000:1.0:1784404946.003171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404946.003227:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707952256 00000100:00100000:1.0:1784404946.003236:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707952256 00000100:00100000:1.0:1784404946.003283:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 163 00000100:00100000:1.0:1784404946.003294:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:14922:x1871083707952256:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784404946.003437:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:14922:x1871083707952256:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 144us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404946.003446:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 163 00010000:00010000:0.0:1784404946.245568:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404947.267133:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404948.291490:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404948.491063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.491253:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707952384 00000100:00100000:3.0:1784404948.491282:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707952384 00000100:00100000:3.0:1784404948.491416:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:3.0:1784404948.491430:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+6:15592:x1871083707952384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404948.491455:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404948.491521:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7682 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.491600:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.491616:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.491628:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.491644:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.491651:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.491657:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492519:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7a45d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492533:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7a45d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492542:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7a45d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404948.492594:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404948.492598:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404948.492639:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7a45d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492651:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492657:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492663:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492668:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404948.492672:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492757:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492772:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404948.492775:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404948.492780:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492788:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492807:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.492999:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493006:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493012:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404948.493015:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493020:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493027:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dd5706bc600) 00010000:00010000:3.0:1784404948.493030:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404948.493032:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493038:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a456 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493078:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7682 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493090:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7a45d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7682 expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.493097:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd5706bcb00) 00010000:00010000:3.0:1784404948.493099:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404948.493107:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056400, rc 0) 00000100:00100000:3.0:1784404948.493611:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+7:15592:x1871083707952384:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1787us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404948.493622:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00080000:2.0:1784404948.499709:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404948.504091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.504521:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707952512 00000100:00100000:2.0:1784404948.504534:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707952512 00000100:00100000:2.0:1784404948.504603:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:2.0:1784404948.504616:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+7:15592:x1871083707952512:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784404948.505542:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+7:15592:x1871083707952512:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 Request processed in 924us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.505552:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1784404948.514666:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.514734:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707952768 00000100:00100000:3.0:1784404948.514745:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707952768 00000100:00100000:3.0:1784404948.514812:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:3.0:1784404948.514822:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+7:15592:x1871083707952768:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404948.514844:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404948.514910:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a464 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7689 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.515325:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.515341:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.515353:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.515415:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.515895:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.515906:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.516029:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7a479 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.516053:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7a479 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.516060:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7a479 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404948.516071:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1784404948.519118:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519137:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519145:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519152:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404948.519156:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519164:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519183:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd5706bcb00) 00010000:00010000:3.0:1784404948.519186:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404948.519191:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519198:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a46b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519213:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519248:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519254:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519259:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404948.519262:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519267:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519275:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd5706bc600) 00010000:00010000:3.0:1784404948.519277:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404948.519280:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.519287:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a472 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.520886:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a464 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7689 expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.520910:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7a479 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7689 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.520918:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd5706bc800) 00010000:00010000:3.0:1784404948.520921:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404948.520934:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056e00, rc 0) 00000100:00100000:3.0:1784404948.521021:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15592:x1871083707952768:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 6198us (6374us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784404948.521031:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784404948.528295:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.529741:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707952896 00000100:00100000:2.0:1784404948.529756:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707952896 00000100:00100000:2.0:1784404948.529843:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:2.0:1784404948.529895:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15592:x1871083707952896:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784404948.529996:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15592:x1871083707952896:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 144us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.530004:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:1.0:1784404948.534166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404948.534269:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707953024 00000100:00100000:0.0:1784404948.534279:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707953024 00000100:00100000:0.0:1784404948.534362:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:0.0:1784404948.534383:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15592:x1871083707953024:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1784404948.534717:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1784404948.544978:0:18438:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10529us 00000100:00100000:2.0:1784404948.575119:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15592:x1871083707953024:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 40734us (40961us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.575133:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:1.0:1784404948.578215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.578294:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707953152 00000100:00100000:2.0:1784404948.578304:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707953152 00000100:00100000:2.0:1784404948.578365:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1784404948.578376:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15598:x1871083707953152:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404948.578398:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404948.578423:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7690 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578504:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578520:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578533:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578548:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578575:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578582:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578633:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578649:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578655:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578661:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404948.578666:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578673:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578685:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:2.0:1784404948.578689:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404948.578694:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578700:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a48e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578714:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578728:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578734:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578739:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404948.578743:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578748:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578756:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd44330f100) 00010000:00010000:2.0:1784404948.578760:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404948.578763:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578769:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a495 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578803:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a487 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7690 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.578813:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:2.0:1784404948.578815:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404948.578819:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7690 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.579185:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516ec00, rc 0) 00000100:00100000:2.0:1784404948.579260:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15598:x1871083707953152:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 885us (1053us total) trans 0 rc 301/301 00000100:00100000:2.0:1784404948.579268:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1784404948.590428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.594059:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707953280 00000100:00100000:2.0:1784404948.594077:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707953280 00000100:00100000:2.0:1784404948.594165:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1784404948.594177:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15598:x1871083707953280:12345-192.168.202.42@tcp:700:lfs.0 00000100:00100000:2.0:1784404948.594444:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15598:x1871083707953280:12345-192.168.202.42@tcp:700:lfs.0 Request processed in 269us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.594452:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1784404948.603921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.604024:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707953536 00000100:00100000:3.0:1784404948.604036:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707953536 00000100:00100000:3.0:1784404948.604093:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1784404948.604104:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+9:15598:x1871083707953536:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:3.0:1784404948.604178:0:17153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404948.604206:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a3b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75fd expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.604224:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:3.0:1784404948.604229:0:17153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404948.604282:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.604296:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 5 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.604306:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.604341:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 5 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.604354:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 5 pid: 17153 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404948.604504:0:17153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1871083729000064:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404948.604583:0:17153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784404948.606931:0:17153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17153:1871083729000064:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404948.606961:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404948.610432:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.610536:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707953664 00000100:00100000:2.0:1784404948.610546:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707953664 00010000:00010000:2.0:1784404948.610613:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 6 pid: 17153 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404948.610656:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:2.0:1784404948.610666:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2403:x1871083707953664:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404948.610685:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404948.610692:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 6 pid: 17153 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.610708:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 6 pid: 17153 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.610754:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a3f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed766d expref: 6 pid: 17153 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.610772:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:2.0:1784404948.610777:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.610786:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.610793:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.610827:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404948.610913:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707953664:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 249us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.610920:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00080000:0.0:1784404948.610987:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784404948.611055:0:17153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.611064:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.611087:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.611095:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.611103:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615438:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615459:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615479:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404948.615498:0:17153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4d22574 reply state 00000000ccd1902b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615510:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615525:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:2.0:1784404948.615527:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404948.615531:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784404948.615537:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784404948.615545:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615552:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615560:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615566:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404948.615570:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615577:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615586:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54955f300) 00010000:00010000:2.0:1784404948.615588:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404948.615591:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615598:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a49c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404948.615615:0:17153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4d22574 reply state 00000000ccd1902b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615632:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.615637:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd5706bc600) 00010000:00010000:2.0:1784404948.615641:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404948.615642:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784404948.615755:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+10:15598:x1871083707953536:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 11648us (11838us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784404948.615765:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000040:00080000:1.0:1784404948.675617:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784404948.685516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404948.685561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404948.685634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404948.685698:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707953792 00000100:00100000:0.0:1784404948.685708:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707953792 00000100:00100000:0.0:1784404948.685774:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:0.0:1784404948.685784:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2403:x1871083707953792:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404948.685894:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2403:x1871083707953792:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 111us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404948.685902:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 164 00000100:00100000:1.0:1784404948.689804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.692868:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954048 00000100:00100000:3.0:1784404948.692885:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954048 00000100:00100000:2.0:1784404948.693108:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954304 00000100:00100000:2.0:1784404948.693113:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954304 00000100:00080000:0.0:1784404948.693257:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404948.693308:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1784404948.693324:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707954304:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404948.693444:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707954304:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 124us (7808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404948.693652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404948.693686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404948.693714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404948.693736:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954176 00000100:00100000:1.0:1784404948.693740:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954176 00000100:00100000:1.0:1784404948.693776:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954560 00000100:00100000:1.0:1784404948.693779:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954560 00000100:00100000:1.0:1784404948.693803:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:1.0:1784404948.693810:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707954176:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404948.693889:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707954176:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404948.693896:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:1.0:1784404948.693925:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1784404948.693931:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+10:15606:x1871083707954560:12345-192.168.202.42@tcp:101:lctl.0 00010000:00010000:1.0:1784404948.693948:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404948.693979:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540030800/0x24b3e2e6dcd7a4b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7697 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.694047:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd7a4b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.694067:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd7a4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.694081:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd7a4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404948.694127:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784404948.694131:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404948.694163:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd7a4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.694188:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540030800/0x24b3e2e6dcd7a4b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7697 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.694207:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd7a4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7697 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.694393:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:1.0:1784404948.694397:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784404948.694401:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd540031000, rc 0) 00000100:00100000:1.0:1784404948.694428:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+11:15606:x1871083707954560:12345-192.168.202.42@tcp:101:lctl.0 Request processed in 496us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404948.694435:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00080000:1.0:1784404948.694566:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404948.694570:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404948.694591:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707953920 00000100:00100000:1.0:1784404948.694595:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707953920 00000100:00100000:3.0:1784404948.698112:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954432 00000100:00100000:3.0:1784404948.698130:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954432 00000100:00100000:3.0:1784404948.698183:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:3.0:1784404948.698193:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707954432:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404948.698332:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707954432:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 140us (4644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404948.698354:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:2.0:1784404948.698628:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00080000:2.0:1784404948.698765:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404948.698770:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404948.709742:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1784404948.709774:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707954048:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404948.710324:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707954048:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 565us (24759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404948.710334:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1784404948.710358:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1784404948.710367:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707953920:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404948.710430:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707953920:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 65us (20635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404948.710436:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:1.0:1784404948.711434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.711513:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954688 00000100:00100000:2.0:1784404948.711523:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954688 00000100:00100000:2.0:1784404948.711578:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:2.0:1784404948.711586:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:15607:x1871083707954688:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404948.711603:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404948.711625:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed769e expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.711692:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd7a4c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.711723:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd7a4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.711736:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd7a4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404948.711785:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784404948.711789:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404948.711809:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd7a4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.711896:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed769e expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.711917:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd7a4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed769e expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.711926:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:2.0:1784404948.711930:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784404948.711932:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516f600, rc 0) 00000100:00100000:2.0:1784404948.711981:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15607:x1871083707954688:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 396us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.711987:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:0.0:1784404948.718129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.718240:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954816 00000100:00100000:3.0:1784404948.718251:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954816 00000100:00100000:3.0:1784404948.718316:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:3.0:1784404948.718328:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:15607:x1871083707954816:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404948.718351:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404948.718384:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a4cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76a5 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718463:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718484:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718497:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718509:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718515:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718522:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718606:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a4e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718638:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718645:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404948.718756:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404948.718760:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404948.718783:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718794:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718801:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718807:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718813:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404948.718817:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718824:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718836:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:3.0:1784404948.718839:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404948.718845:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718894:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a4d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718907:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718913:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718919:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718924:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404948.718927:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718934:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718942:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd5706bc600) 00010000:00010000:3.0:1784404948.718945:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404948.718948:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718953:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a4db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.718979:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a4cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76a5 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.719005:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76a5 expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.719013:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:3.0:1784404948.719016:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404948.719019:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056200, rc 0) 00000100:00100000:3.0:1784404948.719182:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+7:15607:x1871083707954816:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 854us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404948.719190:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:0.0:1784404948.731210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.731598:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707954944 00000100:00100000:3.0:1784404948.731608:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707954944 00000100:00100000:3.0:1784404948.731658:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:3.0:1784404948.731669:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:15607:x1871083707954944:12345-192.168.202.42@tcp:900:lfs.0 00000100:00100000:3.0:1784404948.731762:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:15607:x1871083707954944:12345-192.168.202.42@tcp:900:lfs.0 Request processed in 95us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404948.731768:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1784404948.737017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.737157:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707955200 00000100:00100000:2.0:1784404948.737167:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707955200 00000100:00100000:2.0:1784404948.737239:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:2.0:1784404948.737250:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+7:15607:x1871083707955200:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404948.737271:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404948.737306:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76ac expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404948.737411:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784404948.737531:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ac expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.737548:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:2.0:1784404948.737551:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404948.737557:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ac expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.737571:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e000, rc 0) 00000100:00100000:2.0:1784404948.737640:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+8:15607:x1871083707955200:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 392us (632us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1784404948.737647:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:0.0:1784404948.741664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.741765:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707955456 00000100:00100000:2.0:1784404948.741776:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707955456 00000100:00100000:2.0:1784404948.742015:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:2.0:1784404948.742026:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+8:15607:x1871083707955456:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:2.0:1784404948.742088:0:17153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404948.742114:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056200/0x24b3e2e6dcd7a4e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76a5 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.742134:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:2.0:1784404948.742139:0:17153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784404948.742165:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.742201:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.742222:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784404948.742467:0:17153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020633902 reply state 00000000c82f9f19 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.742493:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.742500:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:2.0:1784404948.742503:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1784404948.742505:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784404948.742513:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784404948.742607:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+9:15607:x1871083707955456:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 582us (950us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784404948.742615:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:0.0:1784404948.746706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.746819:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707955712 00000100:00100000:3.0:1784404948.746829:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707955712 00000100:00100000:3.0:1784404948.746960:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:3.0:1784404948.746971:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+9:15607:x1871083707955712:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404948.749551:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+10:15607:x1871083707955712:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 2570us (2843us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784404948.749566:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1784404948.752595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.753071:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707955968 00000100:00100000:2.0:1784404948.753082:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707955968 00000100:00100000:2.0:1784404948.753148:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:2.0:1784404948.753159:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+10:15607:x1871083707955968:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404948.753186:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404948.753208:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76b3 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753309:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753324:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753336:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753348:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753355:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753362:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404948.753479:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784404948.753558:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753565:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753572:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753577:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516fa00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404948.753581:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753598:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753609:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:2.0:1784404948.753612:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404948.753615:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753622:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753633:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753639:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753644:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753648:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404948.753651:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753657:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753663:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd5706bc600) 00010000:00010000:2.0:1784404948.753666:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404948.753669:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753685:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a50c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753720:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76b3 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753731:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:2.0:1784404948.753733:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404948.753737:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a4fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76b3 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.753747:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e000, rc 0) 00000100:00100000:2.0:1784404948.753833:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+11:15607:x1871083707955968:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 676us (1247us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1784404948.753842:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:0.0:1784404948.757026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.757113:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707956096 00000100:00100000:3.0:1784404948.757123:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707956096 00000100:00100000:3.0:1784404948.757187:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:3.0:1784404948.757197:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+11:15607:x1871083707956096:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784404948.757248:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404948.757268:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a51a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76ba expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.757358:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.757372:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.757384:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404948.757429:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784404948.757432:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404948.757453:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.757490:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a51a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.757509:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.757519:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:3.0:1784404948.757522:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784404948.757526:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057000, rc 0) 00000100:00100000:3.0:1784404948.757595:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+12:15607:x1871083707956096:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 400us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404948.757603:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:0.0:1784404948.762435:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.762590:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707956224 00000100:00100000:2.0:1784404948.762602:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707956224 00000100:00100000:2.0:1784404948.762670:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1784404948.762683:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+12:15607:x1871083707956224:12345-192.168.202.42@tcp:37:lfs.0 00000100:00100000:2.0:1784404948.769729:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+12:15607:x1871083707956224:12345-192.168.202.42@tcp:37:lfs.0 Request processed in 7036us (7292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.769744:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1784404948.776453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.776624:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707956480 00000100:00100000:2.0:1784404948.776635:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707956480 00000100:00100000:2.0:1784404948.776688:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:2.0:1784404948.776698:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ec7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+12:15607:x1871083707956480:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404948.776970:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ec7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+13:15607:x1871083707956480:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 273us (526us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1784404948.776976:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:0.0:1784404948.846557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404948.846625:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707956608 00000100:00100000:1.0:1784404948.846657:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707956608 00000100:00100000:1.0:1784404948.847122:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:1.0:1784404948.847136:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+11:15613:x1871083707956608:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784404948.847160:0:18438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404948.847185:0:18438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540030800/0x24b3e2e6dcd7a528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76c1 expref: -99 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847257:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847271:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847282:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847313:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847322:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847329:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847413:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331da00/0x24b3e2e6dcd7a53d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847422:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331da00/0x24b3e2e6dcd7a53d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847429:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331da00/0x24b3e2e6dcd7a53d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404948.847491:0:18438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784404948.847495:0:18438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404948.847534:0:18438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331da00/0x24b3e2e6dcd7a53d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847547:0:18438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847554:0:18438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847561:0:18438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847568:0:18438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404948.847572:0:18438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847580:0:18438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847593:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:1.0:1784404948.847596:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404948.847601:0:18438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847607:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031800/0x24b3e2e6dcd7a52f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847621:0:18438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847637:0:18438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847643:0:18438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847648:0:18438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404948.847652:0:18438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847658:0:18438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847666:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd5706bc600) 00010000:00010000:1.0:1784404948.847668:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404948.847671:0:18438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847690:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d000/0x24b3e2e6dcd7a536 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847717:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540030800/0x24b3e2e6dcd7a528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c1 expref: 13 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847733:0:18438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331da00/0x24b3e2e6dcd7a53d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c1 expref: 12 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.847740:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:1.0:1784404948.847742:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784404948.847750:0:18438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331da00, rc 0) 00000100:00100000:1.0:1784404948.848116:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+12:15613:x1871083707956608:12345-192.168.202.42@tcp:101:bash.0 Request processed in 981us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404948.848124:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1784404948.854575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.854762:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707956736 00000100:00100000:2.0:1784404948.854773:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707956736 00000100:00100000:2.0:1784404948.854845:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1784404948.854892:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15613:x1871083707956736:12345-192.168.202.42@tcp:900:bash.0 00000100:00100000:2.0:1784404948.854979:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15613:x1871083707956736:12345-192.168.202.42@tcp:900:bash.0 Request processed in 124us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.854986:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784404948.859965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.860195:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707956992 00000100:00100000:3.0:1784404948.860206:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707956992 00000100:00100000:3.0:1784404948.860441:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:3.0:1784404948.860452:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+12:15613:x1871083707956992:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784404948.860483:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404948.860503:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a544 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76c8 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.860606:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.860620:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.860630:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.860661:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.860674:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 12 pid: 17155 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404948.860686:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729000192:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784404948.860893:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580ac240 going to sleep for 11 seconds 00000100:00100000:3.0:1784404948.863777:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729000192:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784404948.863808:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404948.864903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404948.865031:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707957120 00000100:00100000:3.0:1784404948.865040:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707957120 00010000:00010000:3.0:1784404948.865080:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 13 pid: 17155 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404948.865123:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:3.0:1784404948.865133:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+13:2404:x1871083707957120:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404948.865148:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404948.865155:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 13 pid: 17155 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.865172:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 13 pid: 17155 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.865194:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a521 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76ba expref: 13 pid: 17155 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.865209:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:3.0:1784404948.865213:0:17141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.865235:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.865242:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404948.865274:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404948.865333:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+12:2404:x1871083707957120:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 202us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404948.865342:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00010000:00010000:1.0:1784404948.865523:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.865531:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.865555:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.865565:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.865573:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866102:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866113:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866121:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404948.866131:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784404948.866160:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866167:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866184:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866191:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404948.866195:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866203:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866213:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:1.0:1784404948.866230:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404948.866234:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866241:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057c00/0x24b3e2e6dcd7a54b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784404948.866254:0:17155:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d8cfa4f reply state 000000005ac5005f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866264:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866270:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd574d22a00) 00010000:00010000:1.0:1784404948.866272:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784404948.866275:0:17155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784404948.866312:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7a544 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 15 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866326:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 14 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404948.866339:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404948.866342:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1784404948.866349:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c000, rc 0) 00000100:00100000:1.0:1784404948.866590:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+15:15613:x1871083707956992:12345-192.168.202.42@tcp:101:bash.0 Request processed in 6138us (6634us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1784404948.866599:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:1.0:1784404948.869890:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729000448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404948.869963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404948.870044:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729000448 00000100:00100000:2.0:1784404948.870052:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729000448 00000100:00080000:1.0:1784404948.870117:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404948.870122:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784404948.870132:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729000448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404948.870163:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784404948.870218:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729000448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.870226:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784404948.870288:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729000320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404948.870319:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404948.870630:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729000448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404948.876030:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729000320 00000100:00100000:2.0:1784404948.876047:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729000320 00000100:00100000:2.0:1784404948.876902:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784404948.876914:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729000320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404948.876948:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784404948.877039:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729000320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (6718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.877064:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784404948.877251:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729000320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784404948.878273:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404948.886242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.886374:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707957248 00000100:00100000:2.0:1784404948.886384:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707957248 00000100:00100000:2.0:1784404948.886438:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:2.0:1784404948.886448:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+15:15613:x1871083707957248:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784404948.886482:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404948.886505:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a567 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76cf expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.886577:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.886592:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.886603:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404948.886660:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784404948.886664:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784404948.886697:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.886709:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.886736:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a567 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.886754:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404948.886791:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:2.0:1784404948.886793:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784404948.886797:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e600, rc 0) 00000100:00100000:2.0:1784404948.887485:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+16:15613:x1871083707957248:12345-192.168.202.42@tcp:101:bash.0 Request processed in 1035us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404948.887496:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:1.0:1784404948.891112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404948.891255:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707957504 00000100:00100000:2.0:1784404948.891266:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707957504 00000100:00100000:2.0:1784404948.891324:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:2.0:1784404948.891337:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+16:15613:x1871083707957504:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:2.0:1784404948.891698:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+17:15613:x1871083707957504:12345-192.168.202.42@tcp:35:bash.0 Request processed in 361us (594us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1784404948.891706:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000040:00080000:0.0:1784404948.932104:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784404949.009964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.010038:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707957760 00000100:00100000:2.0:1784404949.010049:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707957760 00000100:00100000:2.0:1784404949.010117:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:2.0:1784404949.010130:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+17:15623:x1871083707957760:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784404949.010166:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404949.010191:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76d6 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784404949.010304:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784404949.010434:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a575 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76d6 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.010481:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:2.0:1784404949.010485:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404949.010491:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76d6 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.010504:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e000, rc 0) 00000100:00100000:2.0:1784404949.010588:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+18:15623:x1871083707957760:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 460us (634us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1784404949.010595:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:0.0:1784404949.013423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.013544:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707958016 00000100:00100000:2.0:1784404949.013552:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707958016 00000100:00100000:2.0:1784404949.013604:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:2.0:1784404949.013615:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+18:15623:x1871083707958016:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:2.0:1784404949.013985:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+19:15623:x1871083707958016:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 371us (571us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784404949.013993:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:3.0:1784404949.048988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404949.049073:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707958272 00000100:00100000:1.0:1784404949.049084:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707958272 00000100:00100000:1.0:1784404949.049153:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:1.0:1784404949.049174:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+19:15626:x1871083707958272:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784404949.049202:0:18438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404949.049223:0:18438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7a583 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76dd expref: -99 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.049344:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a58a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.049358:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.049400:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404949.049412:0:18438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784404949.049545:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7a583 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76dd expref: 22 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.049563:0:18438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a58a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76dd expref: 21 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.049571:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.049574:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404949.049577:0:18438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d400, rc 0) 00000100:00100000:1.0:1784404949.049644:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+21:15626:x1871083707958272:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 473us (668us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1784404949.049651:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:0.0:1784404949.053307:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404949.053343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.053360:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707958400 00000100:00100000:2.0:1784404949.053369:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707958400 00000100:00100000:1.0:1784404949.053405:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707958528 00000100:00100000:1.0:1784404949.053409:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707958528 00000100:00100000:1.0:1784404949.053486:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1784404949.053496:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+21:2401:x1871083707958528:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404949.053514:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404949.053539:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a58a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76dd expref: 21 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.053557:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.053562:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404949.053643:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+20:2401:x1871083707958528:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 148us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404949.053652:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1784404949.055748:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:2.0:1784404949.055762:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+20:15626:x1871083707958400:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:2.0:1784404949.055884:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.055902:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.055935:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.055979:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.055987:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.055994:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.056001:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404949.056005:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.056013:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.056024:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:2.0:1784404949.056027:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784404949.056031:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.056037:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a598 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404949.056131:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+20:15626:x1871083707958400:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 371us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404949.056139:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:0.0:1784404949.058287:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404949.058429:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707958784 00000100:00100000:3.0:1784404949.058441:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707958784 00000100:00100000:3.0:1784404949.058528:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:3.0:1784404949.058538:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+20:15626:x1871083707958784:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1784404949.058762:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+21:15626:x1871083707958784:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 225us (483us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1784404949.058770:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00010000:00010000:1.0:1784404949.315262:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404949.347320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404949.347526:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707959040 00000100:00100000:1.0:1784404949.347537:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707959040 00000100:00100000:1.0:1784404949.347647:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:1.0:1784404949.347658:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+21:15657:x1871083707959040:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:1.0:1784404949.347682:0:18438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404949.347703:0:18438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a59f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76e4 expref: -99 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.347845:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7a5a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.347900:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7a5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.347912:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7a5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404949.347924:0:18438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784404949.348045:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a59f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76e4 expref: 24 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.348064:0:18438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7a5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76e4 expref: 23 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.348073:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.348083:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404949.348086:0:18438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d800, rc 0) 00000100:00100000:1.0:1784404949.348136:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+23:15657:x1871083707959040:12345-192.168.202.42@tcp:101:cat.0 Request processed in 480us (826us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1784404949.348143:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:0.0:1784404949.352668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404949.353280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.353425:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707959424 00000100:00100000:2.0:1784404949.353438:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707959424 00000100:00100000:2.0:1784404949.353583:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:2.0:1784404949.353594:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+23:2404:x1871083707959424:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404949.353611:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404949.353637:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7a5a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76e4 expref: 23 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.353658:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:2.0:1784404949.353663:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404949.353725:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+22:2404:x1871083707959424:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 133us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404949.353733:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1784404949.353872:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707959296 00000100:00100000:3.0:1784404949.353878:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707959296 00000100:00100000:3.0:1784404949.353908:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:3.0:1784404949.353916:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+22:15657:x1871083707959296:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:3.0:1784404949.354210:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+23:15657:x1871083707959296:12345-192.168.202.42@tcp:35:cat.0 Request processed in 293us (1552us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1784404949.354217:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1784404949.416919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404949.417018:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707959680 00000100:00100000:1.0:1784404949.417028:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707959680 00000100:00100000:1.0:1784404949.417093:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:1.0:1784404949.417104:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+23:15663:x1871083707959680:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1784404949.417128:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404949.417148:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76eb expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.417276:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.417291:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.417300:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.417308:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.417345:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.417359:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 24 pid: 17154 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404949.417403:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729000576:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404949.417705:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.417715:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 24 pid: 17155 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404949.417725:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57330b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729000704:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404949.417751:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54300 going to sleep for 11 seconds 00000100:00100000:1.0:1784404949.420978:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729000576:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404949.420993:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57330b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729000704:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404949.421021:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404949.422600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404949.422793:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707959808 00000100:00100000:3.0:1784404949.422802:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707959808 00010000:00010000:3.0:1784404949.422886:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 25 pid: 17154 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404949.422931:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1784404949.422943:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+25:2403:x1871083707959808:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404949.422958:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404949.422979:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 25 pid: 17154 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404949.422992:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 25 pid: 17154 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404949.423013:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e600/0x24b3e2e6dcd7a56e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76cf expref: 25 pid: 17154 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404949.423028:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:3.0:1784404949.423033:0:17141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404949.423041:0:17141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404949.423047:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404949.423089:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+24:2403:x1871083707959808:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 150us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404949.423096:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1784404949.426335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.426502:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707959936 00000100:00100000:2.0:1784404949.426515:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707959936 00010000:00010000:2.0:1784404949.426563:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 24 pid: 17155 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404949.426611:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:2.0:1784404949.426623:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+24:2404:x1871083707959936:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784404949.426642:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784404949.426649:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 24 pid: 17155 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.426663:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 24 pid: 17155 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.426707:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7a559 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c8 expref: 24 pid: 17155 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.426723:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:2.0:1784404949.426727:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.426735:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.426742:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.426774:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784404949.426830:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+23:2404:x1871083707959936:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 209us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404949.426847:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00010000:00010000:1.0:1784404949.427022:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.427030:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404949.427048:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784404949.427206:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76eb expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.427220:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76eb expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.427235:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.427238:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784404949.427240:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c600, rc 0) 00000100:00100000:1.0:1784404949.427269:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+23:15663:x1871083707959680:12345-192.168.202.42@tcp:101:dd.0 Request processed in 10167us (10360us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1784404949.427276:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:0.0:1784404949.433966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.434184:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707960064 00000100:00100000:2.0:1784404949.434194:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707960064 00000100:00100000:2.0:1784404949.434252:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:2.0:1784404949.434263:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+23:15663:x1871083707960064:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:2.0:1784404949.434288:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404949.434310:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76f2 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.434345:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.434390:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.434403:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.434531:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 25 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.434550:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.434559:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:2.0:1784404949.434561:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784404949.434565:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516fa00, rc 0) 00000100:00100000:2.0:1784404949.434619:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+24:15663:x1871083707960064:12345-192.168.202.42@tcp:101:dd.0 Request processed in 358us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404949.434626:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1784404949.441215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.441314:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707960320 00000100:00100000:2.0:1784404949.441324:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707960320 00000100:00100000:2.0:1784404949.441398:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:2.0:1784404949.441410:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+24:15663:x1871083707960320:12345-192.168.202.42@tcp:36:dd.0 00010000:00010000:2.0:1784404949.441679:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.441698:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.441730:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784404949.441776:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1784404949.441802:0:17153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e9888e6 reply state 000000005f21a61d transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.441815:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.441823:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:2.0:1784404949.441826:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784404949.441829:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784404949.441957:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+27:15663:x1871083707960320:12345-192.168.202.42@tcp:36:dd.0 Request processed in 548us (750us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1784404949.441964:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000020:00080000:2.0:1784404949.441969:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784404949.447812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.449375:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707960448 00000100:00100000:2.0:1784404949.449391:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707960448 00000100:00100000:1.0:1784404949.449799:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:1.0:1784404949.449815:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+27:15663:x1871083707960448:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1784404949.449886:0:18438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404949.449909:0:18438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed76f9 expref: -99 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.449971:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f9 expref: 28 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.449987:0:18438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f9 expref: 28 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.450007:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.450010:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404949.450014:0:18438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d400, rc 0) 00000100:00100000:1.0:1784404949.450093:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15663:x1871083707960448:12345-192.168.202.42@tcp:101:dd.0 Request processed in 283us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404949.450101:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:0.0:1784404949.469282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404949.469635:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707960704 00000100:00100000:1.0:1784404949.469663:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707960704 00000100:00100000:1.0:1784404949.469992:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:1.0:1784404949.470005:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15663:x1871083707960704:12345-192.168.202.42@tcp:103:dd.0 00010000:00010000:1.0:1784404949.470026:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404949.470054:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f9 expref: 28 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.470074:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.470079:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404949.470149:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+27:15663:x1871083707960704:12345-192.168.202.42@tcp:103:dd.0 Request processed in 146us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404949.470215:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:0.0:1784404949.477051:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404949.477555:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707960832 00000100:00100000:2.0:1784404949.477569:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707960832 00000100:00100000:2.0:1784404949.477711:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:2.0:1784404949.477723:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+27:15663:x1871083707960832:12345-192.168.202.42@tcp:58:dd.0 00010000:00010000:2.0:1784404949.478237:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.478258:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404949.478270:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784404949.483348:0:17153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784404949.485757:0:17153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1784404949.486024:0:17153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1784404949.486160:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+27:15663:x1871083707960832:12345-192.168.202.42@tcp:58:dd.0 Request processed in 8431us (9108us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404949.486172:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:0.0:1784404949.493777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404949.494052:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707960960 00000100:00100000:1.0:1784404949.494063:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707960960 00000100:00100000:1.0:1784404949.494139:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:1.0:1784404949.494150:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+27:15663:x1871083707960960:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1784404949.494178:0:18438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404949.494200:0:18438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7700 expref: -99 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.494262:0:18438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.494273:0:18438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 28 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.494294:0:18438:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.494329:0:18438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 28 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.494343:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.494346:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404949.494351:0:18438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 28 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.494358:0:18438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d400, rc 0) 00000100:00100000:1.0:1784404949.494444:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15663:x1871083707960960:12345-192.168.202.42@tcp:101:dd.0 Request processed in 295us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404949.494451:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:2.0:1784404949.892897:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729000832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404949.892983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404949.893254:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729000832 00000100:00100000:0.0:1784404949.893264:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729000832 00000100:00100000:0.0:1784404949.893326:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784404949.893336:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729000832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784404949.893377:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1784404949.893596:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729000832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 261us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404949.893605:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784404949.897834:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729000960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784404949.898567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404949.898715:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729000960 00000100:00100000:1.0:1784404949.898725:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729000960 00000100:00100000:1.0:1784404949.898790:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784404949.898801:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729000960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784404949.898872:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784404949.898922:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729000960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404949.898930:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784404949.900169:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729000960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784404949.900734:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729000832:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1784404949.955175:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784404949.955184:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784404949.955215:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784404949.955226:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1784404949.955378:0:17189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d89500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17189:1871083729001088:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784404949.955514:0:17189:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44264c840 going to sleep for 11 seconds 00000100:00100000:0.0:1784404949.964987:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404949.965307:0:17189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d89500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17189:1871083729001088:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784404949.968920:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707961088 00000100:00100000:1.0:1784404949.968937:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707961088 00000100:00100000:1.0:1784404949.969022:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:1.0:1784404949.969034:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15664:x1871083707961088:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784404949.969068:0:17155:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784404949.969224:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15664:x1871083707961088:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 191us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404949.969233:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:3.0:1784404949.990840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404949.991021:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707961216 00000100:00100000:1.0:1784404949.991031:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707961216 00000100:00100000:1.0:1784404949.991092:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:1.0:1784404949.991103:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15664:x1871083707961216:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784404949.991200:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991217:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991229:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991293:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991300:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991307:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991331:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991339:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991344:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404949.991425:0:18438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784404949.991429:0:18438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784404949.991446:0:18438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991467:0:18438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991474:0:18438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991482:0:18438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991488:0:18438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331de00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404949.991493:0:18438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991501:0:18438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991515:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd5706bc800) 00010000:00010000:1.0:1784404949.991519:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404949.991524:0:18438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991530:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7a5f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991545:0:18438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991561:0:18438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991567:0:18438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991572:0:18438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404949.991575:0:18438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991581:0:18438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991588:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9dd574d22500) 00010000:00010000:1.0:1784404949.991591:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404949.991593:0:18438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991598:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a5fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991616:0:18438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991621:0:18438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991626:0:18438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991630:0:18438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331cc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404949.991640:0:18438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991645:0:18438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991652:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.991654:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404949.991657:0:18438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.991663:0:18438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a601 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404949.991752:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15664:x1871083707961216:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 651us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404949.991760:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:0.0:1784404949.995481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404949.995615:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707961472 00000100:00100000:1.0:1784404949.995627:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707961472 00000100:00100000:1.0:1784404949.995694:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:1.0:1784404949.995704:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+28:15664:x1871083707961472:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404949.995727:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404949.995751:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a608 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7707 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.995929:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.995945:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.995987:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784404949.995999:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784404949.996114:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996122:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996130:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996142:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404949.996147:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996154:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996167:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404949.996170:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784404949.996175:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996182:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a60f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996229:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a608 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7707 expref: 30 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996254:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd5706bc800) 00010000:00010000:1.0:1784404949.996256:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784404949.996260:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a608 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7707 expref: 30 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404949.996269:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331ca00, rc 0) 00000100:00100000:1.0:1784404949.996347:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+29:15664:x1871083707961472:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 645us (897us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1784404949.996356:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:0.0:1784404950.000126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.000235:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707961600 00000100:00100000:1.0:1784404950.000245:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707961600 00000100:00100000:1.0:1784404950.000341:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:1.0:1784404950.000352:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+29:15664:x1871083707961600:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000100:00080000:2.0:1784404950.000453:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1784404950.000696:0:18438:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784404950.000843:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+29:15664:x1871083707961600:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 492us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.000898:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:3.0:1784404950.006151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.007192:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707961856 00000100:00100000:1.0:1784404950.007206:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707961856 00000100:00100000:1.0:1784404950.007289:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:1.0:1784404950.007308:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+29:15664:x1871083707961856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404950.007331:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404950.007352:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a61d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed770e expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784404950.007892:0:17155:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:1.0:1784404950.007907:0:17155:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1784404950.007931:0:17155:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1784404950.008125:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a624 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.008141:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a624 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.008159:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a624 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.008222:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a61d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed770e expref: 32 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.008241:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a624 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed770e expref: 31 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.008250:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22500) 00010000:00010000:1.0:1784404950.008253:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784404950.008257:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c200, rc 0) 00000100:00100000:1.0:1784404950.008333:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+31:15664:x1871083707961856:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1034us (2200us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1784404950.008341:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1784404950.021700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.022163:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707962112 00000100:00100000:3.0:1784404950.022175:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707962112 00000100:00100000:3.0:1784404950.022241:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:3.0:1784404950.022252:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+31:15664:x1871083707962112:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784404950.022707:0:17154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404950.022752:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7a624 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed770e expref: 31 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.022773:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22500) 00010000:00010000:3.0:1784404950.022788:0:17154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404950.022815:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.022829:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.022950:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023013:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023022:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023029:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023075:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023083:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023090:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023097:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404950.023109:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023117:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023126:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:3.0:1784404950.023129:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404950.023133:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023139:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a632 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023162:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023169:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023175:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023180:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404950.023183:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023189:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023196:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x221c480c (ffff9dd5706bc500) 00010000:00010000:3.0:1784404950.023199:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404950.023208:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.023213:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a639 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x221c480c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404950.023310:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+30:15664:x1871083707962112:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1059us (1623us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784404950.023319:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:0.0:1784404950.026992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.027087:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707962240 00000100:00100000:1.0:1784404950.027099:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707962240 00000100:00100000:1.0:1784404950.027162:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:1.0:1784404950.027174:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+30:15664:x1871083707962240:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404950.027212:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404950.027239:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a640 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7715 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.027287:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a647 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.027301:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a647 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.027312:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a647 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.027436:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a640 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7715 expref: 32 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.027454:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a647 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7715 expref: 31 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.027474:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:1.0:1784404950.027477:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404950.027481:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331cc00, rc 0) 00000100:00100000:1.0:1784404950.027546:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+31:15664:x1871083707962240:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 374us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.027554:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:0.0:1784404950.033587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.033678:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707962496 00000100:00100000:1.0:1784404950.033689:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707962496 00000100:00100000:1.0:1784404950.033751:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:1.0:1784404950.033761:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+31:15664:x1871083707962496:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784404950.033903:0:18438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.033920:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.033934:0:18438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784404950.034109:0:18438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1784404950.034119:0:18438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567918266833ns, next at 568918264499ns, rc = 0 00000004:00010000:1.0:1784404950.034171:0:18438:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b80777f reply state 000000000ac7f0cd transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.034184:0:18438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.034191:0:18438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:1.0:1784404950.034194:0:18438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1784404950.034198:0:18438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784404950.037578:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+33:15664:x1871083707962496:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 3803us (3987us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1784404950.037594:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:0.0:1784404950.049050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.049160:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707962624 00000100:00100000:1.0:1784404950.049172:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707962624 00000100:00100000:1.0:1784404950.049238:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:1.0:1784404950.049249:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+33:15664:x1871083707962624:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784404950.049517:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784404950.049543:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed771c expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.049628:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 34 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.049643:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 34 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.049662:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:1.0:1784404950.049665:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404950.049669:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331ca00, rc 0) 00000100:00100000:1.0:1784404950.049740:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+34:15664:x1871083707962624:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 492us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.049749:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:0.0:1784404950.061154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404950.061256:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707962752 00000100:00100000:2.0:1784404950.061272:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707962752 00000100:00100000:2.0:1784404950.061365:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:2.0:1784404950.061377:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707962752:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784404950.061651:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2403:x1871083707962752:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 275us (507us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1784404950.061659:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00080000:1.0:1784404950.061803:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404950.065838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.072629:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707963008 00000100:00100000:3.0:1784404950.072647:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707963008 00000100:00100000:2.0:1784404950.077623:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:2.0:1784404950.077639:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+34:15664:x1871083707963008:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784404950.079061:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+35:15664:x1871083707963008:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 1416us (13227us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784404950.079073:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:0.0:1784404950.091156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.091368:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707963264 00000100:00100000:3.0:1784404950.091378:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707963264 00000100:00100000:3.0:1784404950.091445:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1784404950.091455:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+35:15664:x1871083707963264:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784404950.091592:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+35:15664:x1871083707963264:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 138us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.091600:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:0.0:1784404950.094540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.094634:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707963392 00000100:00100000:3.0:1784404950.094645:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707963392 00000100:00100000:3.0:1784404950.094706:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:3.0:1784404950.094717:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+35:15664:x1871083707963392:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784404950.094739:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404950.094761:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a65c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7723 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.094834:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a663 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.094892:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a663 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.094904:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a663 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784404950.094950:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784404950.094971:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a663 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.094998:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a65c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7723 expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.095019:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a663 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7723 expref: 36 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.095028:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:3.0:1784404950.095031:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784404950.095034:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057000, rc 0) 00000100:00100000:3.0:1784404950.095093:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+36:15664:x1871083707963392:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 378us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.095100:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:0.0:1784404950.103396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404950.103495:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707963520 00000100:00100000:2.0:1784404950.103505:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707963520 00000100:00100000:2.0:1784404950.103583:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1784404950.103594:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+6:2404:x1871083707963520:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784404950.103615:0:19139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784404950.103641:0:19139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed772a expref: -99 pid: 19139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784404950.103669:0:19139:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bdbd6, blocks: 0x0 00010000:00010000:2.0:1784404950.103693:0:19139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1784404950.103698:0:19139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404950.103707:0:19139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 7 pid: 19139 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.103727:0:19139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 7 pid: 19139 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.103741:0:19139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd54516e600, rc 0) 00000100:00100000:2.0:1784404950.103818:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+7:2404:x1871083707963520:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 225us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.103825:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1784404950.106715:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.106805:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707963776 00000100:00100000:3.0:1784404950.106816:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707963776 00000100:00100000:3.0:1784404950.106922:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:3.0:1784404950.106934:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+36:15664:x1871083707963776:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784404950.107061:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+36:15664:x1871083707963776:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 129us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.107090:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:3.0:1784404950.111129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404950.111238:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707963904 00000100:00100000:2.0:1784404950.111251:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707963904 00000100:00100000:2.0:1784404950.111321:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1784404950.111333:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+36:15664:x1871083707963904:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784404950.114586:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1784404950.114602:0:17134:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1784404950.114657:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1784404950.114960:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+19:15664:x1871083707963904:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 3624us (3836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.114972:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00010000:00010000:1.0:1784404950.115220:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115233:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115240:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115246:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404950.115252:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115260:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115285:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9dd5706bc600) 00010000:00010000:1.0:1784404950.115289:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404950.115294:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115301:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7a4a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115321:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115328:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115334:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115338:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404950.115341:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115345:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115352:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:1.0:1784404950.115354:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404950.115369:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115376:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e200/0x24b3e2e6dcd7a4aa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115398:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115404:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115410:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115414:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404950.115417:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115423:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115431:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9dd574d22a00) 00010000:00010000:1.0:1784404950.115433:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404950.115435:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115440:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a552 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115455:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115470:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115476:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115488:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404950.115492:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115498:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115508:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404950.115510:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404950.115513:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115519:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516e000/0x24b3e2e6dcd7a5d7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115532:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115537:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115543:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115547:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784404950.115549:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115554:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115571:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:1.0:1784404950.115573:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784404950.115576:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.115581:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a64e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.115600:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784404950.115616:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729001216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784404950.115669:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404950.115815:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729001216 00000100:00100000:2.0:1784404950.115823:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729001216 00000100:00100000:2.0:1784404950.115910:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784404950.115920:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729001216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784404950.116051:0:18660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784404950.116055:0:18660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784404950.116057:0:18660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784404950.116060:0:18660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784404950 -> 1784404950 00002000:00010000:2.0:1784404950.116063:0:18660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784404950.116100:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083729001216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (429us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784404950.116107:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1784404950.118207:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.118224:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.118233:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.118239:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516f400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404950.118244:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.118251:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.118281:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:3.0:1784404950.118284:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1784404950.118289:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.118294:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f400/0x24b3e2e6dcd7a4f7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404950.118577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00080000:1.0:1784404950.118700:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1784404950.118753:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd573263100/2, rc 0, transno 8589934596 00000100:00100000:1.0:1784404950.118761:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729001216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784404950.119070:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707964032 00000100:00100000:3.0:1784404950.119078:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707964032 00000100:00100000:3.0:1784404950.119134:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:3.0:1784404950.119143:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+7:2403:x1871083707964032:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1784404950.119621:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+7:2403:x1871083707964032:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 476us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.119630:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1784404950.125354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.125435:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707964288 00000100:00100000:3.0:1784404950.125447:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707964288 00000100:00100000:3.0:1784404950.125529:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:3.0:1784404950.125541:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+15:15664:x1871083707964288:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784404950.125603:0:17154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404950.125637:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a663 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7723 expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.125658:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:3.0:1784404950.125663:0:17154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404950.125691:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.125705:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.125716:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784404950.125918:0:17154:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005965fa7e reply state 00000000de5039e3 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.125931:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.125936:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:3.0:1784404950.125938:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784404950.125941:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784404950.126026:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+16:15664:x1871083707964288:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 487us (683us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1784404950.126050:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:3.0:1784404950.129710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404950.132532:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707964416 00000100:00100000:0.0:1784404950.132549:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707964416 00000100:00100000:0.0:1784404950.132636:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1784404950.132648:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0a674842-02a6-4a6f-8c44-65f09b70250a+7:2404:x1871083707964416:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784404950.132826:0:19703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784404950.132830:0:19703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1784404949 00002000:00010000:0.0:1784404950.132833:0:19703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1784404949 00002000:00010000:0.0:1784404950.132835:0:19703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784404950 -> 1784404949 00002000:00010000:0.0:1784404950.133229:0:19703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1784404950.134430:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0a674842-02a6-4a6f-8c44-65f09b70250a+8:2404:x1871083707964416:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 1767us (4715us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784404950.134442:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1784404950.140413:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404950.140559:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707964544 00000100:00100000:2.0:1784404950.140570:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707964544 00000100:00100000:2.0:1784404950.140639:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:2.0:1784404950.140651:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+8:2403:x1871083707964544:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784404950.140699:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140719:0:18662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784404950.140724:0:18662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404950.140730:0:18662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140770:0:18662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140800:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140808:0:18662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140816:0:18662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140824:0:18662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404950.140828:0:18662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140836:0:18662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140892:0:18662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.140902:0:18662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7a678 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404950.140992:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+8:2403:x1871083707964544:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 342us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.141001:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:2.0:1784404950.150659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.150756:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707964800 00000100:00100000:1.0:1784404950.150767:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707964800 00000100:00100000:1.0:1784404950.150834:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:1.0:1784404950.150845:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+16:15664:x1871083707964800:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784404950.150976:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.150995:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.151025:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.151063:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.151077:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 16 pid: 17154 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.151091:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729001344:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404950.151968:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552680cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784404950.163064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.163161:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707964928 00000100:00100000:3.0:1784404950.163170:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707964928 00010000:00010000:3.0:1784404950.163214:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 17 pid: 17154 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404950.163258:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1784404950.163269:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+17:2403:x1871083707964928:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404950.163284:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404950.163290:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 17 pid: 17154 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.163303:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 17 pid: 17154 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.163325:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:3.0:1784404950.163332:0:17141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 17 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.163341:0:17141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.163349:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.163369:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.163407:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404950.163478:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+17:2403:x1871083707964928:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 210us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.163485:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00010000:00010000:1.0:1784404950.164330:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516fa00/0x24b3e2e6dcd7a5d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76f2 expref: 16 pid: 17154 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.164349:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729001344:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404950.164382:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.164392:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.164398:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.164641:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.164653:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 16 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.164669:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.164705:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 16 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.164720:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 16 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.164735:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729001472:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784404950.164811:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552680600 going to sleep for 11 seconds 00000100:00100000:1.0:1784404950.168316:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573309500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729001472:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784404950.168350:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404950.170176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.170638:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707965056 00000100:00100000:1.0:1784404950.170648:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707965056 00010000:00010000:1.0:1784404950.170687:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 17 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.170729:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784404950.170739:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+17:2404:x1871083707965056:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404950.170754:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404950.170760:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 17 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.170796:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 17 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.170820:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a655 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed771c expref: 17 pid: 17155 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.170839:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:1.0:1784404950.170845:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.170883:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.170891:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.170918:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404950.170973:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+16:2404:x1871083707965056:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 234us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.170981:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00010000:00010000:0.0:1784404950.171624:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.171634:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404950.171738:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1784404950.171840:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1784404950.171899:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1784404950.171969:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1871083729001600:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784404950.172019:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404950.172048:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5456830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784404950.172593:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729001600 00000100:00100000:1.0:1784404950.172599:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729001600 00000100:00100000:1.0:1784404950.172634:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784404950.172641:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17155:x1871083729001600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784404950.172723:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17155:x1871083729001600:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.172730:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784404950.173716:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1871083729001600:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1784404950.173899:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1784404950.173958:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1871083729001728:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784404950.174000:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404950.174026:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83be40 going to sleep for 11 seconds 00000100:00100000:1.0:1784404950.174623:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729001728 00000100:00100000:1.0:1784404950.174630:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729001728 00000100:00100000:1.0:1784404950.174688:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784404950.174697:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17155:x1871083729001728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784404950.174831:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17155:x1871083729001728:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (828us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1784404950.175054:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17155:1871083729001728:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1784404950.175096:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175106:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175125:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175131:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404950.175135:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175142:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175164:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:3.0:1784404950.175167:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404950.175172:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175177:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7a686 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175211:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175233:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175238:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175243:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ec00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404950.175246:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175252:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175261:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:3.0:1784404950.175263:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784404950.175270:0:17155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 19 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175281:0:17155:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 19 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175290:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 19 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.175348:0:17155:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 19 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404950.175590:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729001856:192.168.202.42@tcp:105: 00000100:00100000:3.0:1784404950.175668:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5580acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784404950.175922:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784404950.181430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404950.181513:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707965184 00000100:00100000:1.0:1784404950.181522:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707965184 00000100:00100000:1.0:1784404950.181580:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784404950.181591:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ec4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+20:15663:x1871083707965184:12345-192.168.202.42@tcp:49:dd.0 00000100:00100000:1.0:1784404950.181729:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ec4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+20:15663:x1871083707965184:12345-192.168.202.42@tcp:49:dd.0 Request processed in 139us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.181737:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:3.0:1784404950.182049:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17155:1871083729001856:192.168.202.42@tcp:105: 00010000:00010000:3.0:1784404950.182077:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182086:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516ec00/0x24b3e2e6dcd7a5e5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182120:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182135:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182146:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182155:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182161:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182168:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182174:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404950.182177:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182184:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182214:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:3.0:1784404950.182217:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784404950.182221:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182226:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a68d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182236:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182243:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182249:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182255:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784404950.182258:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182264:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182271:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:3.0:1784404950.182273:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784404950.182275:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.182281:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7a67f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404950.182427:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+19:15664:x1871083707964800:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 31583us (31777us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1784404950.182436:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000020:00080000:3.0:1784404950.182440:0:17155:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784404950.182634:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784404950.182639:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784404950.182653:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784404950.182658:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1784404950.190085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404950.190192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.190396:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707965568 00000100:00100000:3.0:1784404950.190407:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707965568 00000100:00100000:3.0:1784404950.190484:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:3.0:1784404950.190496:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+19:15663:x1871083707965568:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:3.0:1784404950.190521:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784404950.190544:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a694 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7731 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.190576:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a69b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.190589:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a69b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.190601:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a69b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.190726:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7a694 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7731 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.190746:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a69b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7731 expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.190754:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:3.0:1784404950.190766:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784404950.190770:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057000, rc 0) 00000100:00100000:3.0:1784404950.190833:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+20:15663:x1871083707965568:12345-192.168.202.42@tcp:101:dd.0 Request processed in 339us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.191267:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:1.0:1784404950.199378:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707965440 00000100:00100000:1.0:1784404950.199394:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707965440 00000100:00100000:1.0:1784404950.199486:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1784404950.199498:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+20:15664:x1871083707965440:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784404950.199775:0:17156:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784404950.199811:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1784404950.199844:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.199887:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.199899:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.199926:0:17156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.199933:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.199939:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.199953:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784404950.200050:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+22:15664:x1871083707965440:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 554us (9973us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1784404950.200058:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000020:00080000:1.0:1784404950.200063:0:17156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784404950.200439:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404950.200446:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.200475:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331ca00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784404950.200480:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.200493:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.200509:0:17142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:0.0:1784404950.200512:0:17142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784404950.200517:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.200523:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7a6a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.200543:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404950.200545:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404950.200546:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404950.340881:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404950.423136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404950.423535:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707965696 00000100:00100000:2.0:1784404950.423547:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707965696 00000100:00100000:2.0:1784404950.423625:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1784404950.423636:0:18665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+8:2402:x1871083707965696:12345-192.168.202.42@tcp:4:dd.0 00010000:00010000:2.0:1784404950.423701:0:18665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.423725:0:18665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 8 pid: 19139 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.423734:0:18665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404950.423739:0:18665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784404950.423743:0:18665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.423783:0:18665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 8 pid: 19139 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.423799:0:18665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 8 pid: 19139 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404950.423827:0:18665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573260380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18665:1871083729001984:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784404950.423954:0:18665:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44328c000 going to sleep for 11 seconds 00000100:00100000:2.0:1784404950.427352:0:18665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573260380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18665:1871083729001984:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784404950.427394:0:18665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404950.430820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404950.430930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404950.431672:0:18667:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784404950.431687:0:18667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1784404950.431812:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707965952 00000100:00100000:1.0:1784404950.431823:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707965952 00010000:00010000:1.0:1784404950.431900:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 9 pid: 19139 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.431938:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1784404950.431948:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+9:2403:x1871083707965952:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404950.431964:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404950.431990:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 9 pid: 19139 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.432005:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 9 pid: 19139 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.432046:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088580ea0/0x24b3e2e6dcd7a66a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed772a expref: 9 pid: 19139 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.432064:0:17140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404950.432068:0:17140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784404950.432073:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.432083:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.432350:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784404950.432447:0:18665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404950.432467:0:18665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.433005:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+8:2403:x1871083707965952:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1055us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.433014:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:0.0:1784404950.440986:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707965824 00000100:00100000:0.0:1784404950.441002:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707965824 00000100:00100000:0.0:1784404950.441999:0:20296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:0.0:1784404950.442016:0:20296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+8:2402:x1871083707965824:12345-192.168.202.42@tcp:4:dd.0 00010000:00010000:0.0:1784404950.442058:0:20296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.442076:0:20296:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404950.442089:0:20296:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784404950.442097:0:20296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404950.442112:0:20296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784404950.600501:0:18656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1784404950.600531:0:18656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1784404950.601982:0:18665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1784404950.601990:0:18665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1784404949 -> 1784404950 00002000:00010000:1.0:1784404950.601992:0:18665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784404949 -> 1784404950 00002000:00010000:1.0:1784404950.601995:0:18665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1784404950.602012:0:18665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.602025:0:18665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.602034:0:18665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.602049:0:18665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784404950.602054:0:18665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.602063:0:18665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.602084:0:18665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404950.602091:0:18665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b659a02d/0x24b3e2e6dcd7a6a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404950.603577:0:18665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+7:2402:x1871083707965696:12345-192.168.202.42@tcp:4:dd.0 Request processed in 179932us (180439us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1784404950.603602:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000001:00080000:0.0:1784404950.651169:0:18656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1784404950.654334:0:20296:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1784404950.654342:0:20296:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1784404950.654372:0:20296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.654386:0:20296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.654396:0:20296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.654404:0:20296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784404950.654409:0:20296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.654418:0:20296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.654483:0:20296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404950.654492:0:20296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065c7e391/0x24b3e2e6dcd7a6b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784404950.654614:0:20296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2402:x1871083707965824:12345-192.168.202.42@tcp:4:dd.0 Request processed in 212598us (223677us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784404950.654625:0:20296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:0.0:1784404950.915466:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404950.915494:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729002112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404950.915574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404950.915620:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404950.915628:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729002240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784404950.915652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404950.915680:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729002112 00000100:00100000:0.0:1784404950.915687:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729002112 00000100:00100000:0.0:1784404950.915734:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729002240 00000100:00100000:0.0:1784404950.915737:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729002240 00000100:00100000:0.0:1784404950.915758:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404950.915767:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729002112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404950.915801:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404950.915880:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729002112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404950.915886:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784404950.915905:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784404950.915911:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729002240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784404950.915938:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404950.915967:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729002240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404950.915974:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784404950.916012:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729002112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404950.916039:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729002240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404950.916313:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729002624:0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.916350:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404950.916381:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729003136:0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.916402:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404950.916418:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784404950.916423:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729002496:0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.916446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404950.916478:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729003008:0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.916511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404950.916526:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729003520:0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.916546:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784404950.916566:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404950.916578:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729002496 00000100:00100000:1.0:1784404950.916582:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729002496 00000100:00100000:1.0:1784404950.916610:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784404950.916615:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729002496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.916657:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729002496:12345-0@lo:400:kworker.0 Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404950.916664:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784404950.916695:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729002496:0@lo:400:kworker.0 00000100:00100000:3.0:1784404950.916765:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729002624 00000100:00100000:3.0:1784404950.916769:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729002624 00000100:00100000:3.0:1784404950.916797:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003136 00000100:00100000:3.0:1784404950.916799:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003136 00000100:00100000:3.0:1784404950.916835:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003008 00000100:00100000:3.0:1784404950.916838:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003008 00000100:00100000:3.0:1784404950.916848:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003520 00000100:00100000:3.0:1784404950.916876:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003520 00000100:00100000:3.0:1784404950.916894:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784404950.916901:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729002624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404950.916942:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729002624:12345-0@lo:400:kworker.0 Request processed in 41us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.916948:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784404950.916963:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404950.916969:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083729003136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404950.916998:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083729003136:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.917013:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404950.917026:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784404950.917032:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729003008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404950.917061:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729003008:12345-0@lo:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.917067:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784404950.917078:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784404950.917085:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083729003520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404950.917110:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083729003520:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.917115:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784404950.917487:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729002752:0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.917526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404950.917562:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083729003264:0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.917584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404950.917605:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784404950.917612:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729002368:0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.917641:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404950.917667:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729002880:0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.917689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404950.917707:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729003392:0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.917731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404950.917769:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729002368 00000100:00100000:2.0:1784404950.917773:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729002368 00000100:00100000:2.0:1784404950.917808:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784404950.917827:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3646:x1871083729002368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.917900:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3646:x1871083729002368:12345-0@lo:400:kworker.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.917906:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784404950.917937:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729002880 00000100:00100000:2.0:1784404950.917940:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729002880 00000100:00100000:2.0:1784404950.917969:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784404950.917975:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729002880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.918003:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729002880:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.918009:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784404950.918047:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729002368:0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.918059:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729002880:0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.918088:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003264 00000100:00100000:2.0:1784404950.918091:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003264 00000100:00100000:2.0:1784404950.918114:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003392 00000100:00100000:2.0:1784404950.918117:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003392 00000100:00100000:2.0:1784404950.918130:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784404950.918135:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083729003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.918168:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083729003264:12345-0@lo:400:kworker.0 Request processed in 32us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.918174:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784404950.918186:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404950.918191:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083729003392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404950.918226:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083729003392:12345-0@lo:400:kworker.0 Request processed in 24us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404950.918240:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784404950.918263:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729003392:0@lo:400:kworker.0 00010000:00080000:2.0:1784404950.918275:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348dc00 x1871083729003264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404950.918285:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083729003264:0@lo:400:kworker.0 00000100:00100000:3.0:1784404950.918495:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729002752 00000100:00100000:3.0:1784404950.918500:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729002752 00000100:00100000:3.0:1784404950.918538:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404950.918544:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729002752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404950.918586:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729002752:12345-0@lo:400:kworker.0 Request processed in 43us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404950.918592:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784404950.918615:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729002752:0@lo:400:kworker.0 00000100:00080000:1.0:1784404950.918684:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404950.918689:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404950.918691:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404950.918713:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729003008:0@lo:400:kworker.0 00010000:00080000:1.0:1784404950.918724:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44348f100 x1871083729003520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404950.918733:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729003520:0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.918745:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729002624:0@lo:400:kworker.0 00000100:00100000:1.0:1784404950.918755:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729003136:0@lo:400:kworker.0 00010000:00010000:2.0:1784404951.364800:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404952.393245:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784404952.843078:0:20333:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1784404953.412575:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404953.807077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404953.807174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404953.807210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404953.807258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404953.807260:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966336 00000100:00100000:2.0:1784404953.807270:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966336 00000100:00100000:1.0:1784404953.807280:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404953.807296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404953.807311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404953.807326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404953.807332:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966848 00000100:00100000:2.0:1784404953.807335:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966848 00000100:00100000:2.0:1784404953.807349:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966208 00000100:00100000:2.0:1784404953.807351:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966208 00000100:00100000:1.0:1784404953.807356:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404953.807362:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966720 00000100:00100000:2.0:1784404953.807365:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966720 00000100:00100000:2.0:1784404953.807382:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1784404953.807391:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707966336:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:1.0:1784404953.807396:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784404953.807399:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404953.807408:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966592 00000100:00100000:1.0:1784404953.807412:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966592 00000100:00100000:1.0:1784404953.807470:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707967104 00000100:00100000:1.0:1784404953.807473:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707967104 00000100:00100000:2.0:1784404953.807491:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707966336:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 101us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404953.807499:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:1.0:1784404953.807499:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966464 00000100:00100000:1.0:1784404953.807502:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966464 00000100:00100000:1.0:1784404953.807512:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966976 00000100:00100000:2.0:1784404953.807514:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1784404953.807514:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966976 00000100:00100000:2.0:1784404953.807520:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707966848:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404953.807527:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:1.0:1784404953.807533:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707966592:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404953.807544:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707966848:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404953.807550:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1784404953.807555:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707966592:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404953.807561:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:1.0:1784404953.807561:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1784404953.807573:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57330aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+22:2403:x1871083707966208:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404953.807578:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1784404953.807584:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707967104:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404953.807602:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57330aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+22:2403:x1871083707966208:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404953.807608:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:1.0:1784404953.807618:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707967104:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 33us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404953.807619:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:2.0:1784404953.807636:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2403:x1871083707966720:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404953.807636:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1784404953.807649:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1784404953.807655:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707966464:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404953.807661:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2403:x1871083707966720:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 37us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404953.807667:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:1.0:1784404953.807683:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2403:x1871083707966464:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404953.807689:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:2.0:1784404953.807693:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:2.0:1784404953.807699:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707966976:12345-192.168.202.42@tcp:400:kworker.0 00000100:00080000:1.0:1784404953.807705:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784404953.807707:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404953.807721:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2403:x1871083707966976:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404953.807727:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:0.0:1784404953.821418:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707966080 00000100:00100000:0.0:1784404953.821445:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707966080 00000100:00100000:0.0:1784404953.821534:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:0.0:1784404953.821545:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2403:x1871083707966080:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404953.821651:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2403:x1871083707966080:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 108us (14585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404953.821659:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:1.0:1784404953.988315:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729003648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404953.988473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404953.988883:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003648 00000100:00100000:3.0:1784404953.988891:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003648 00000100:00100000:3.0:1784404953.988954:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784404953.988965:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729003648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784404953.988995:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784404953.989051:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729003648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404953.989068:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784404953.989238:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404953.989252:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729003776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404953.989265:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729003648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404953.989288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404953.989328:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003776 00000100:00100000:0.0:1784404953.989332:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003776 00000100:00100000:0.0:1784404953.989361:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784404953.989368:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729003776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404953.989381:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784404953.989435:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729003776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404953.989450:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784404953.989453:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1784404953.989460:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9dd573263100, transno 8589934596 00000004:00080000:3.0:1784404953.989477:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1784404953.989503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729003776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784404953.989568:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784404954.437003:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41702 lines, 41702 kept, 0 dropped, 0 bad.